-- Logs begin at Wed 2022-08-10 12:55:44 UTC, end at Wed 2022-08-10 13:57:38 UTC. -- Aug 10 13:29:22.075309 dv-cinder-852009-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 10 13:29:22.084498 dv-cinder-852009-3-iscsi devstack@n-api.service[103343]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 10 13:29:22.086572 dv-cinder-852009-3-iscsi devstack@n-api.service[103343]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 10 13:29:22 2022] *** Aug 10 13:29:22.086572 dv-cinder-852009-3-iscsi devstack@n-api.service[103343]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 13:29:22.086572 dv-cinder-852009-3-iscsi devstack@n-api.service[103343]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 13:29:22.086572 dv-cinder-852009-3-iscsi devstack@n-api.service[103343]: nodename: dv-cinder-852009-3-iscsi Aug 10 13:29:22.086572 dv-cinder-852009-3-iscsi devstack@n-api.service[103343]: machine: x86_64 Aug 10 13:29:22.086572 dv-cinder-852009-3-iscsi devstack@n-api.service[103343]: clock source: unix Aug 10 13:29:22.086572 dv-cinder-852009-3-iscsi devstack@n-api.service[103343]: pcre jit disabled Aug 10 13:29:22.086572 dv-cinder-852009-3-iscsi devstack@n-api.service[103343]: detected number of CPU cores: 4 Aug 10 13:29:22.086572 dv-cinder-852009-3-iscsi devstack@n-api.service[103343]: current working directory: / Aug 10 13:29:22.086572 dv-cinder-852009-3-iscsi devstack@n-api.service[103343]: detected binary path: /usr/bin/uwsgi-core Aug 10 13:29:22.086572 dv-cinder-852009-3-iscsi devstack@n-api.service[103343]: your processes number limit is 47680 Aug 10 13:29:22.086572 dv-cinder-852009-3-iscsi devstack@n-api.service[103343]: your memory page size is 4096 bytes Aug 10 13:29:22.086572 dv-cinder-852009-3-iscsi devstack@n-api.service[103343]: detected max file descriptor number: 2048 Aug 10 13:29:22.086572 dv-cinder-852009-3-iscsi devstack@n-api.service[103343]: lock engine: pthread robust mutexes Aug 10 13:29:22.090549 dv-cinder-852009-3-iscsi devstack@n-api.service[103343]: thunder lock: enabled Aug 10 13:29:22.090549 dv-cinder-852009-3-iscsi devstack@n-api.service[103343]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 10 13:29:22.090549 dv-cinder-852009-3-iscsi devstack@n-api.service[103343]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 10 13:29:22.125874 dv-cinder-852009-3-iscsi devstack@n-api.service[103343]: Python main interpreter initialized at 0x55cd5acd59c0 Aug 10 13:29:22.125874 dv-cinder-852009-3-iscsi devstack@n-api.service[103343]: python threads support enabled Aug 10 13:29:22.125874 dv-cinder-852009-3-iscsi devstack@n-api.service[103343]: your server socket listen backlog is limited to 100 connections Aug 10 13:29:22.125874 dv-cinder-852009-3-iscsi devstack@n-api.service[103343]: your mercy for graceful operations on workers is 90 seconds Aug 10 13:29:22.126221 dv-cinder-852009-3-iscsi devstack@n-api.service[103343]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 13:29:22.126294 dv-cinder-852009-3-iscsi devstack@n-api.service[103343]: *** Operational MODE: preforking *** Aug 10 13:29:22.126546 dv-cinder-852009-3-iscsi devstack@n-api.service[103343]: *** uWSGI is running in multiple interpreter mode *** Aug 10 13:29:22.126546 dv-cinder-852009-3-iscsi devstack@n-api.service[103343]: spawned uWSGI master process (pid: 103343) Aug 10 13:29:22.126744 dv-cinder-852009-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 10 13:29:22.129265 dv-cinder-852009-3-iscsi devstack@n-api.service[103343]: spawned uWSGI worker 1 (pid: 103344, cores: 1) Aug 10 13:29:22.129265 dv-cinder-852009-3-iscsi devstack@n-api.service[103343]: spawned uWSGI worker 2 (pid: 103345, cores: 1) Aug 10 13:29:22.129265 dv-cinder-852009-3-iscsi devstack@n-api.service[103343]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 13:29:22.783183 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 13:29:22.783785 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 13:29:23.860542 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 13:29:23.860542 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: from cryptography.utils import int_from_bytes Aug 10 13:29:23.861318 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 13:29:23.861318 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: from cryptography.utils import int_from_bytes Aug 10 13:29:23.863321 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 13:29:23.863321 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: from cryptography.utils import int_from_bytes Aug 10 13:29:23.863744 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 13:29:23.863744 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: from cryptography.utils import int_from_bytes Aug 10 13:29:26.354237 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 13:29:26.354734 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 13:29:26.355112 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 13:29:26.355211 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 13:29:26.355292 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 13:29:26.355369 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 13:29:26.355461 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 13:29:26.355584 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 13:29:26.355681 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 13:29:26.355854 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 13:29:26.355953 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.356226 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.356330 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.356551 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.356637 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.356866 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.356951 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.357469 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.357605 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.357775 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.357888 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.358648 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.358754 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.358971 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.359058 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.359289 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.359375 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.359580 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.359675 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.359884 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.359970 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.360181 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.360275 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852009-3-iscsi {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.360500 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.360604 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852009-3-iscsi {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.360800 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.360892 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.361104 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.361198 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.361439 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.361536 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.361739 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.361823 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.362054 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.362150 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.362361 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.362448 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.362673 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.362868 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.363275 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.363385 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.363507 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.363589 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.363786 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.363873 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.364093 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.364284 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.364429 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.364520 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.364725 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.364812 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.365032 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.365128 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.365374 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.365498 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.365686 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.365771 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.365989 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.366077 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.366299 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.366397 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852009-3-iscsi {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.366671 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.366756 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852009-3-iscsi {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.366977 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.367071 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.367286 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.367372 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.367600 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.367706 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.367974 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.368073 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.368277 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.368365 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.368592 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.368678 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.368908 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.369004 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.369209 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.369355 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.369547 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.369644 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.369859 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.369946 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.370169 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.370301 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.370480 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.370576 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.370775 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.370862 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.371074 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.371168 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.371376 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.371478 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.371681 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.371767 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.371977 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.372070 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.372272 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.372368 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.372516 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.372602 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.372815 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.372909 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.373119 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.373212 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.373457 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.373554 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.373806 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.374133 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.374234 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.374385 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.374475 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.374628 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.374726 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.374947 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.375042 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.375262 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.375348 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.375563 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.375650 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.375866 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.375979 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.376167 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.376258 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.376467 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.376563 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.376766 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.376852 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.377067 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.377163 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.377393 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.377493 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.377699 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.377787 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.378021 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.378115 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.378332 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.378432 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.378652 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.378745 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.378957 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.379054 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.379274 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.379368 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.379665 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.379758 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.379912 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.379999 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.380212 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.380314 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.380544 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.380642 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.380855 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.380942 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.381156 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.381283 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.381494 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.381597 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.381807 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.381893 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.382106 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.382193 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.382407 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.382495 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.382705 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.382791 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.383016 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.383103 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.383339 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.383426 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.383639 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.383736 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.383885 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.383979 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.384178 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.384263 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.384472 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.384617 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.384783 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.384871 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.385080 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.385165 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.385400 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.385506 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.385698 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.385785 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.385991 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.386078 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.386287 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.386381 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.386584 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.386671 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.386880 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.386968 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.387177 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.387277 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.387479 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.387564 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.387772 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.387857 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.388069 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.388231 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.388364 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.388464 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.388661 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.388754 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.388972 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.389059 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.389338 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.389430 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.389636 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.389723 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.389934 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.390036 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.390233 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.390333 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.390529 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.390617 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.390841 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.390936 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.391138 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.391226 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.391433 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.391527 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.391744 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.391831 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.392042 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.392130 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.392339 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.392424 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.392649 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.392737 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.392947 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.393034 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.393268 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.393388 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.393591 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.393704 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.393890 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.393985 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.394196 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.394290 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.394514 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.394622 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.394817 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.394914 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.395115 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.395202 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.395410 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.395498 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.395707 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.395793 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.396004 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.396099 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.396301 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.396387 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.396597 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.396690 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.396893 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.396992 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.397185 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.397297 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.397523 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.397608 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.397836 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.397934 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.398136 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.398231 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.398435 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.398521 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.398732 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.398827 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.399043 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.399129 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:29:26.399367 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.399453 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.399690 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.399783 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.400024 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.400116 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.400329 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.400422 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.400653 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.400741 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.400977 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.401069 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.401311 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.401402 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.401620 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.401708 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.401925 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.402018 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.402242 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.402340 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.402544 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.402631 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.402847 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.402941 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.403154 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.403249 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.403463 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.403550 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.403774 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.403880 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.404096 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.404192 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.404405 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.404494 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.404713 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.404801 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.405574 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.405675 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.405888 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.405975 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.406211 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.406299 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.406543 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.406644 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.406864 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.406958 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.407174 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.407260 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.407506 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.407600 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.407848 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.407934 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.408153 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.408279 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.408470 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.408565 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.408785 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.408872 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.409089 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.409183 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.409418 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.409510 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.409725 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.409813 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.410041 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.410129 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.410363 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.410458 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.410668 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.410756 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.410978 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.411065 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.411281 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.411370 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.411586 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.411679 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.411890 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.411995 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.412192 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.412279 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.412495 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.412590 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.412824 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.412920 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.413132 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.413219 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.413469 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.413555 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.413771 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.413870 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.414083 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.414170 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.414385 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.414481 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.414687 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.414787 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.414988 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.415087 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.415287 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.415374 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.415583 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.415687 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.415878 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.415973 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.416180 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.416267 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.416478 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.416566 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.416789 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.416876 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.417106 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.417201 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.417429 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.417519 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.417756 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.417843 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.418055 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.418189 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.418360 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.418456 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.418660 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.418747 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.418962 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.419048 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.419260 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.419347 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.419561 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.419647 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.419863 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.419960 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.420163 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.420251 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.420531 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.421185 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.421381 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.421492 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.421682 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.421777 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.421998 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.422092 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.422302 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.422399 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.422602 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.422690 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.422908 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.423002 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.423214 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.423311 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.423516 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.423604 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.423821 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.423908 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.424128 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.424216 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.424447 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.424534 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.424752 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.424840 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.425057 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.425145 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.425407 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.425499 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.425729 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.425828 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.426027 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.426115 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.426343 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.426430 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.426659 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.426746 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.426968 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.427055 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.427265 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.427351 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.427568 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.427664 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.427871 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.427958 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.428166 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.428296 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.428468 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.428596 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.428767 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.428865 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.429061 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.429157 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.429379 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.429488 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.429673 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.429768 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.429969 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.430054 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.430266 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.430362 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.430582 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.430669 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.430884 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.430970 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.431179 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.431281 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.431477 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.431586 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.431771 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.431867 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.432103 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.432202 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.432401 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.432487 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.432735 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.432822 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.433064 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.433151 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.433400 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.433492 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.433718 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.433804 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.434022 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.434110 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.434328 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.434415 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.434633 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.434727 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.434936 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.435022 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.435238 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.435330 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.435541 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.435649 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.435856 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.435954 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.436187 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.436287 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.436493 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.436598 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.436795 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.436883 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.437112 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.437198 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.437438 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.437539 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.437758 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.437862 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.438056 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.438140 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.438365 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.438545 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.438694 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.438781 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.439023 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.439124 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.439330 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.439425 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.439645 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.439730 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.439947 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.440033 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.440254 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.440349 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.440556 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.440642 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.440859 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.440945 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.441161 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.441269 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.441490 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.441601 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.441801 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.441896 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.442101 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.442189 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.442410 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.442504 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.442710 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.442804 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.443024 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.443114 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.443324 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.443410 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.443631 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.443727 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.443927 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.444020 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.444235 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.444321 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.444554 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.444648 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.444877 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.444963 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.445178 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.445283 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.445511 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.445608 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.445821 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.445921 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.446123 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.446218 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.446427 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.446523 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.446729 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.446816 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.447025 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.447124 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.447320 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.447416 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.447627 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.447712 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.447928 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.448012 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.448232 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.448349 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.448533 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.448658 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.448829 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.448925 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.449135 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.449260 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.449458 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.449565 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.449751 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.449848 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.450045 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.450133 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.450346 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.450434 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.450660 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.450756 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.450959 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.451055 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.451272 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.451367 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.451601 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.452223 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.452401 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.452489 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.452697 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.452785 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.453012 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.453109 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.453338 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.453430 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.453634 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.453730 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.453929 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.454027 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.454224 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.454311 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.454555 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.454642 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.454857 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.454953 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.455152 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.455238 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.455461 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.455567 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.455771 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.455860 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.456072 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.456168 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.456377 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.456464 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.456678 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.456767 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.456980 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.457067 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.457313 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.457404 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.457620 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.457708 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.457921 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.458009 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.458225 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.458331 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.458526 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.458622 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.458825 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.458920 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.459124 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.459219 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.459437 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.459536 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.459738 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.459826 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.460062 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.460169 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.460338 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.460426 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.460632 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.460719 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.460931 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.461025 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.461247 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.461347 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.461822 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.461921 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.462150 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.462240 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.462465 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.462552 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.462783 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.462877 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.463097 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.463186 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.463410 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.463504 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.463736 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.463824 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.464058 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.464145 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.464391 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.464488 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.464694 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.464793 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.465000 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.465095 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.465325 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.465419 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.465628 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.465717 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.465933 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.466021 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.466236 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.466340 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.466535 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.466631 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.466835 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.466923 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.467140 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.467229 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.467974 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.468070 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.468275 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.468362 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.468573 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.468711 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.468873 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.468962 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.469179 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.469304 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.469503 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.469592 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.469808 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.469905 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.470106 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.470203 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.470422 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.470510 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.470724 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.470811 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.471020 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.471116 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.471317 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.471412 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.471613 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.471714 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.471948 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.472056 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.472241 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.472337 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.472571 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.472660 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.472893 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.472981 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.473260 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.473357 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.473550 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.473649 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.473848 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.473937 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.474164 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.474251 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.474462 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.474550 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.474759 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.474848 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.475056 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.475143 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.475359 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.475455 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.475661 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.475760 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.475957 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.476045 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.476254 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.476352 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.476554 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.476648 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.476857 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.476943 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.477159 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.477277 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.477478 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.477565 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.477780 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.477874 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.478081 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.478176 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.478396 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.478483 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.478703 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.478790 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.479006 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.479094 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.479308 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.479395 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.479609 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.479694 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.479913 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.480001 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.480206 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.480292 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.480508 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.480601 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.480801 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.480889 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.481108 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.481195 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.481429 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.481519 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.481727 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.481815 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.482025 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.482406 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.482599 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.482719 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.482901 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.483023 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.483219 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.483315 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.483534 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.483644 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.483836 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.483930 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.484134 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.484229 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.484430 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.484533 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.484731 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.484824 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.485026 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.485119 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.485342 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.485456 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.485642 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.485729 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.485956 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.486042 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.486333 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.486440 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.486560 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.486658 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.486863 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.486949 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.487162 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.487249 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.487460 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.487548 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.487756 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.487842 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.488064 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.488150 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.488355 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.488448 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.488648 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.488734 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.488942 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.489051 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.489260 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.489358 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.489552 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.489655 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.489866 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.489952 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.490167 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.490260 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.490464 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.490559 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.490763 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.490858 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.491055 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.491140 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.491388 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.491550 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.491682 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.491769 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.492030 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.492131 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.492328 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.492435 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.492633 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.492726 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.492941 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.493027 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.493268 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.493372 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.493565 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.493653 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.493868 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.493953 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.494165 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.494258 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.494472 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.494557 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.494773 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.494858 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.495076 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.495172 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.495371 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.495458 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.495666 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.495754 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.495979 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.496066 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.496280 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.496385 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.496585 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.496680 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.496899 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.496998 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.497211 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.497308 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.497547 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.497657 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.497848 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.497933 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.498149 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.498234 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.498449 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.498543 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.498776 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.498872 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.499076 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.499161 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.499379 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.499487 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.499678 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.499764 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.499979 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.500074 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.500281 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.500381 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.500582 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.500669 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.500883 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.500970 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.501181 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.501315 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.501504 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.501591 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.501805 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.501894 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.502102 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.502191 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.502419 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.502508 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.502720 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.502806 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.503018 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.503106 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.503320 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.503449 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.503616 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.503703 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.503917 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.504004 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.504212 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.504298 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.504627 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.504723 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.504931 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.505018 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.505251 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.505341 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.505552 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.505651 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.505854 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.505939 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.506155 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.506241 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.506461 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.506591 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.506766 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.506854 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.507063 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.507156 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.507473 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.507574 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.507778 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.507864 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.508082 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.508176 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.508384 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.508470 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.508679 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.508771 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.508974 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.509067 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.509296 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.509412 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.509617 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.509713 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.509912 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.509998 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.510209 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.510296 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.510506 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.510593 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.510822 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.510908 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.511121 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.511214 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.511435 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.511529 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.511840 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.511939 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.512144 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.512243 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.512442 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.512529 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.512846 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.512940 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.513149 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.513274 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.513475 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.513563 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.513792 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.513893 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.514106 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.514677 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.514947 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.515122 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.515234 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.515352 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.515537 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.515635 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.515840 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.515926 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.516155 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.516241 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.516473 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.516568 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.516776 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.516866 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.517083 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.517177 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.517410 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.517507 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.517725 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.517818 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.518039 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.518125 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.518349 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.518442 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.518661 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.518748 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.519067 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.519154 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.519381 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.519468 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.519683 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.519789 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.519991 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.520084 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.520305 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.520392 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.520601 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.520694 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.520897 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.520991 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.521200 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.521351 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.521518 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.521604 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.521813 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.521913 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.522127 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.522272 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.522422 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.522545 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.522723 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.522819 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.523022 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.523109 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.523322 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.523414 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.523618 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.523713 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.523911 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.524006 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.524225 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.524312 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.524518 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.524605 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.524832 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.524917 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.525135 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.525284 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.525476 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.525571 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.525792 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.525886 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.526092 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.526179 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.526406 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.526493 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.526706 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.526837 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.527003 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.527090 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.527298 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.527386 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.527593 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.527680 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.527924 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.528023 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.528221 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.528307 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.528535 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.528622 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.528856 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.528954 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.529183 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.529310 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.529511 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.529595 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.529879 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.530533 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.530729 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.530825 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.531000 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.531093 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.531310 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.531443 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.531627 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.531715 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.531923 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.532016 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.532219 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.532306 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.532519 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.532657 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.532814 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.532902 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.533110 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.533204 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.533431 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.533521 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.533734 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.533820 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.534032 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.534120 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.534327 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.534414 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.534621 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.534708 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.534934 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.535020 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.535229 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.535316 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.535543 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.535638 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.535845 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.535938 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.536140 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.536225 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.536437 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.536535 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.536730 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.536817 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.537063 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.537156 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.537379 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.537487 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.537698 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.537792 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.538002 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.538089 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.538323 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.538488 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.538631 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.538719 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.538936 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.539029 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.539244 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.539332 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.539548 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.539634 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.539859 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.539977 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.540165 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.540263 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.540469 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.540565 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.540769 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.540857 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.541075 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.541170 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.541405 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.541497 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.541716 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.541804 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.542224 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.542335 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.542551 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.542661 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.542859 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.542967 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.543165 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.543254 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.543471 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.543558 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.543782 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.543950 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.544088 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.544222 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.544378 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.544509 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.544684 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.544827 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.544989 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.545120 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.545318 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.545407 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.545662 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.545755 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.545976 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.546064 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.546294 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.546388 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.546623 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.546711 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.546932 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.547073 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.547241 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.547334 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.547548 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.547636 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.547854 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.547939 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.548200 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.548299 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.548511 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.548597 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.548810 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.548898 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.549118 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.549206 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.549448 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.549535 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.549753 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.549839 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.550058 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.550157 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.550356 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.550453 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.550661 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.550747 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.550967 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.551054 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.551268 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.551356 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.551570 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.551664 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.551874 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.551970 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.552180 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.552266 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.552494 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.552589 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.552821 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.552940 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.553133 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.553250 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.553471 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.553580 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.553785 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.553889 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.554102 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.554209 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.554614 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.554710 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.554920 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.555008 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.555249 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.555356 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.555565 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.555654 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.555882 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.555970 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.556191 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.556277 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.556501 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.556590 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.556818 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.556906 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.557117 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.557216 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.557440 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.557531 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.557744 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.557831 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.558045 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.558133 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.558347 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.558434 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.558660 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.558755 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.558962 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.559063 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.559256 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.559344 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.559567 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.559655 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.559870 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.559970 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.560391 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.560487 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.560726 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.560814 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.561036 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.561133 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.561403 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.561499 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.561724 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.561814 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.562035 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.562131 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.562336 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.562431 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.562654 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.562748 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.562953 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.563043 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.563252 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.563340 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.563559 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.563653 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.563866 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.563955 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.564166 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.564274 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.564463 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.564552 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.564766 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.564856 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.565070 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.565156 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.565397 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.565496 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.565700 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.565788 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.565997 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.566084 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.566314 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.566415 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.566614 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.566708 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.566912 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.567000 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.567213 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.567340 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.567516 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.567605 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.567813 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.567899 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.568110 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.568206 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.568416 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.568501 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.568709 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.568794 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.569013 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.569108 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.569334 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.569427 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.569638 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.569724 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.569935 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.570023 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.570241 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.570354 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.570540 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.570636 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.570842 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.570938 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.571139 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.571235 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.571454 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.571550 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.571751 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.571847 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.572092 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.572187 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.572399 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.572502 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.572699 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.572798 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.573015 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.573111 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.573348 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.573457 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.573652 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.573747 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.573989 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.574091 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.574297 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.574469 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.574822 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.574916 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.575153 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.575247 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.575471 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.575575 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.575798 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.575892 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.576127 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.576221 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.576413 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.576559 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.577288 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.577428 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.577570 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.577659 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.577900 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.577997 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.578208 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.578302 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.578516 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.578605 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.578826 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.578914 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.579137 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.579225 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.579446 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.579534 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.579757 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.579846 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.580069 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.580157 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.580379 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.580475 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.580679 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.580765 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.580986 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.581073 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.581312 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.581415 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.581618 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.581705 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.581922 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.582017 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.582225 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.582321 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.582531 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.582619 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.582864 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.582959 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.583175 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.583264 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.583483 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.583577 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.583795 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.583891 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.584104 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.584192 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.584407 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.584494 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.584714 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.584800 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.585014 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.585101 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.585338 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.585428 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.585646 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.585733 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.585968 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.586060 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.586274 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.586362 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.586570 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.586666 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.586977 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.587066 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.587282 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.587368 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.587593 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.587698 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.587906 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.587995 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.588210 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.588297 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.588526 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.588615 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.588845 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.588938 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.589146 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.589260 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.589485 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.589576 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.589787 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.589876 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.590111 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.590205 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.590442 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.590529 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.590763 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.590858 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.591080 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.591177 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.591380 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.591475 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.591678 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.591766 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.591975 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.592072 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.592277 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.592395 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.593133 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.593218 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.593461 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.593563 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.593760 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.593855 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.594057 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.594144 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.594359 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.594464 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.594657 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.594757 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.594956 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.595043 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.595256 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.595344 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.595552 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.595639 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.595853 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.595949 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.596148 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.596236 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.596442 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.596536 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.596737 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.596826 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.597033 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.597121 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.597351 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.597443 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.597647 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.597752 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.597946 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.598035 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.598241 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.598329 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.598540 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.598634 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.598837 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.598923 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.599133 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.599228 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.599428 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.599525 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.599751 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.599839 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.600076 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.600163 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.600383 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.600479 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.600697 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.600788 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.600999 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.601141 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.601343 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.601445 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.601649 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.601736 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.601964 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.602057 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.602280 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.602368 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.602588 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.602675 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.602893 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.603029 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.603214 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.603309 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.603521 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.603624 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.603825 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.603913 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.604126 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.604223 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.604429 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.604518 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.604732 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.604827 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.605034 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.605122 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.605375 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.605469 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.605694 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.605794 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.605996 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.606096 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.606314 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.606402 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.606624 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.606740 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.606939 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.607027 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.607520 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.607613 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.607826 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.607930 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.608176 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.608264 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.608479 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.608577 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.608787 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.608876 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.609090 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.609186 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.609427 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.609527 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.609730 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.609819 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.610039 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.610135 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.610341 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.610429 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.610643 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.610738 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.610949 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.611037 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.611257 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.611353 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.611574 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.611661 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.611892 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.611980 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.612198 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.612293 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.612515 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.612601 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.612833 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.612921 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.613172 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.613318 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.613503 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.613591 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.613837 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.613924 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.614156 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.614254 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.614465 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.614553 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.614768 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.614862 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.615066 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.615154 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:29:26.615304 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 13:29:26.615393 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 13:29:26.769550 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO dbcounter [None req-f0e9cf28-1532-47e9-bb80-67c0d057c12c None None] Registered counter for database nova_api Aug 10 13:29:26.769756 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO dbcounter [None req-58a13ece-32f0-4559-8c27-0e5261d0c148 None None] Registered counter for database nova_api Aug 10 13:29:26.791470 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG oslo_db.sqlalchemy.engines [None req-f0e9cf28-1532-47e9-bb80-67c0d057c12c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103344) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 13:29:26.793369 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG oslo_db.sqlalchemy.engines [None req-58a13ece-32f0-4559-8c27-0e5261d0c148 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103345) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 13:29:26.797959 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writer thread running {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 13:29:26.799821 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG dbcounter [-] [103345] Writer thread running {{(pid=103345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 13:29:26.852960 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.context [None req-f0e9cf28-1532-47e9-bb80-67c0d057c12c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6d22d841-55fc-4fd5-b0b7-709b32bc1d30(cell1) {{(pid=103344) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 13:29:26.855241 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.context [None req-58a13ece-32f0-4559-8c27-0e5261d0c148 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6d22d841-55fc-4fd5-b0b7-709b32bc1d30(cell1) {{(pid=103345) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 13:29:26.856837 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-f0e9cf28-1532-47e9-bb80-67c0d057c12c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:26.857596 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-f0e9cf28-1532-47e9-bb80-67c0d057c12c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:26.859207 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-f0e9cf28-1532-47e9-bb80-67c0d057c12c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:26.859363 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG oslo_concurrency.lockutils [None req-58a13ece-32f0-4559-8c27-0e5261d0c148 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:26.859836 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG oslo_concurrency.lockutils [None req-58a13ece-32f0-4559-8c27-0e5261d0c148 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:26.859932 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-f0e9cf28-1532-47e9-bb80-67c0d057c12c None None] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:26.860338 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-f0e9cf28-1532-47e9-bb80-67c0d057c12c None None] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:26.861511 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG oslo_concurrency.lockutils [None req-58a13ece-32f0-4559-8c27-0e5261d0c148 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:26.862237 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG oslo_concurrency.lockutils [None req-58a13ece-32f0-4559-8c27-0e5261d0c148 None None] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:26.862347 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-f0e9cf28-1532-47e9-bb80-67c0d057c12c None None] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:26.862680 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG oslo_concurrency.lockutils [None req-58a13ece-32f0-4559-8c27-0e5261d0c148 None None] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:26.864284 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO dbcounter [None req-f0e9cf28-1532-47e9-bb80-67c0d057c12c None None] Registered counter for database nova_cell0 Aug 10 13:29:26.864645 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG oslo_concurrency.lockutils [None req-58a13ece-32f0-4559-8c27-0e5261d0c148 None None] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:26.866633 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO dbcounter [None req-58a13ece-32f0-4559-8c27-0e5261d0c148 None None] Registered counter for database nova_cell0 Aug 10 13:29:26.869659 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO dbcounter [None req-f0e9cf28-1532-47e9-bb80-67c0d057c12c None None] Registered counter for database nova_cell1 Aug 10 13:29:26.871967 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO dbcounter [None req-58a13ece-32f0-4559-8c27-0e5261d0c148 None None] Registered counter for database nova_cell1 Aug 10 13:29:26.878220 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG oslo_db.sqlalchemy.engines [None req-f0e9cf28-1532-47e9-bb80-67c0d057c12c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103344) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 13:29:26.881155 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG oslo_db.sqlalchemy.engines [None req-58a13ece-32f0-4559-8c27-0e5261d0c148 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103345) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 13:29:26.881405 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG oslo_db.sqlalchemy.engines [None req-f0e9cf28-1532-47e9-bb80-67c0d057c12c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103344) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 13:29:26.884032 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG oslo_db.sqlalchemy.engines [None req-58a13ece-32f0-4559-8c27-0e5261d0c148 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103345) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 13:29:26.887815 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG dbcounter [-] [103345] Writer thread running {{(pid=103345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 13:29:26.889166 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writer thread running {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 13:29:26.890078 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writer thread running {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 13:29:27.024208 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG dbcounter [-] [103345] Writer thread running {{(pid=103345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 13:29:27.034299 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO dbcounter [None req-58a13ece-32f0-4559-8c27-0e5261d0c148 None None] Registered counter for database nova_cell0 Aug 10 13:29:27.034431 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO dbcounter [None req-f0e9cf28-1532-47e9-bb80-67c0d057c12c None None] Registered counter for database nova_cell0 Aug 10 13:29:27.041361 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG oslo_db.sqlalchemy.engines [None req-58a13ece-32f0-4559-8c27-0e5261d0c148 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103345) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 13:29:27.044947 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG oslo_db.sqlalchemy.engines [None req-f0e9cf28-1532-47e9-bb80-67c0d057c12c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103344) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 13:29:27.045943 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG dbcounter [-] [103345] Writer thread running {{(pid=103345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 13:29:27.049358 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writer thread running {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 13:29:27.380739 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: WARNING keystonemiddleware.auth_token [None req-f0e9cf28-1532-47e9-bb80-67c0d057c12c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 13:29:27.382828 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: WARNING keystonemiddleware.auth_token [None req-58a13ece-32f0-4559-8c27-0e5261d0c148 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 13:29:27.387967 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: WARNING keystonemiddleware.auth_token [None req-f0e9cf28-1532-47e9-bb80-67c0d057c12c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 13:29:27.390551 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: WARNING keystonemiddleware.auth_token [None req-58a13ece-32f0-4559-8c27-0e5261d0c148 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 13:29:27.729128 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: WARNING keystonemiddleware.auth_token [None req-f0e9cf28-1532-47e9-bb80-67c0d057c12c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 13:29:27.732893 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: WARNING keystonemiddleware.auth_token [None req-58a13ece-32f0-4559-8c27-0e5261d0c148 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 13:29:27.735289 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: WARNING keystonemiddleware.auth_token [None req-f0e9cf28-1532-47e9-bb80-67c0d057c12c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 13:29:27.738870 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: WARNING keystonemiddleware.auth_token [None req-58a13ece-32f0-4559-8c27-0e5261d0c148 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 13:29:27.740495 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cd5acd59c0 pid: 103344 (default app) Aug 10 13:29:27.742589 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-f0e9cf28-1532-47e9-bb80-67c0d057c12c None None] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:29:27.743752 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-f0e9cf28-1532-47e9-bb80-67c0d057c12c None None] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001729 Aug 10 13:29:27.744105 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cd5acd59c0 pid: 103345 (default app) Aug 10 13:29:27.744211 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 788 bytes} [Wed Aug 10 13:29:27 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:30:44.837777 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-f0e9cf28-1532-47e9-bb80-67c0d057c12c None None] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:44.838871 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-f0e9cf28-1532-47e9-bb80-67c0d057c12c None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Aug 10 13:30:44.839354 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 2/2] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 10 13:30:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:30:44.851908 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG dbcounter [-] [103345] Writing DB stats nova_api:SELECT=3 {{(pid=103345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:30:44.852860 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG dbcounter [-] [103345] Writing DB stats nova_cell0:SELECT=3 {{(pid=103345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:30:44.853839 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG dbcounter [-] [103345] Writing DB stats nova_cell1:SELECT=3 {{(pid=103345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:30:44.854882 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG dbcounter [-] [103345] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:30:45.735481 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-4aaa8359-524d-48ef-9c65-09692ef08f4d admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:45.770404 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-4aaa8359-524d-48ef-9c65-09692ef08f4d admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.923624 Aug 10 13:30:45.773639 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 1/3] 10.222.0.52 () {60 vars in 1292 bytes} [Wed Aug 10 13:30:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:48.001111 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-f0e9cf28-1532-47e9-bb80-67c0d057c12c None None] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:48.002289 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-f0e9cf28-1532-47e9-bb80-67c0d057c12c None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002755 Aug 10 13:30:48.002933 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 3/4] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 10 13:30:47 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:30:48.461700 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-adde30e6-0c31-4890-84e1-fdabfc09b7da admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 256, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "cirros256", "disk": 1, "vcpus": 1}} {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:30:48.483521 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 13:30:48.483521 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: warnings.warn(msg) Aug 10 13:30:48.513038 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-adde30e6-0c31-4890-84e1-fdabfc09b7da admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.501950 Aug 10 13:30:48.513891 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 2/5] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Aug 10 13:30:48 2022] POST /compute/v2.1/flavors => generated 407 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 13:30:48.528207 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writing DB stats nova_api:SELECT=3 {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:30:48.529138 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writing DB stats nova_cell0:SELECT=3 {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:30:48.530183 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writing DB stats nova_cell1:SELECT=3 {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:30:48.531108 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:30:48.742643 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-cc0f2b78-6747-499c-9b6f-3a2e3f463b3e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:30:48.747586 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 13:30:48.747586 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: warnings.warn(msg) Aug 10 13:30:48.812528 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-cc0f2b78-6747-499c-9b6f-3a2e3f463b3e admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.290143 Aug 10 13:30:48.813745 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 4/6] 10.222.0.52 () {64 vars in 1336 bytes} [Wed Aug 10 13:30:48 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:51.049278 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-adde30e6-0c31-4890-84e1-fdabfc09b7da admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:51.050298 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-adde30e6-0c31-4890-84e1-fdabfc09b7da admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 10 13:30:51.050695 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 3/7] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 10 13:30:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:30:51.714740 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-6d5bdf19-0186-437b-bb1a-926f4bd74c8c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d1", "vcpus": 1, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds512M", "ram": 512, "os-flavor-access:is_public": true}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:30:51.735095 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 13:30:51.735095 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: warnings.warn(msg) Aug 10 13:30:51.755667 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-6d5bdf19-0186-437b-bb1a-926f4bd74c8c admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.698818 Aug 10 13:30:51.756360 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 5/8] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Aug 10 13:30:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 13:30:51.769591 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-d7d80688-104f-4697-9a44-63f12377a60e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:30:51.772789 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 13:30:51.772789 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: warnings.warn(msg) Aug 10 13:30:51.809741 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-d7d80688-104f-4697-9a44-63f12377a60e admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043815 Aug 10 13:30:51.810565 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 4/9] 10.222.0.52 () {64 vars in 1336 bytes} [Wed Aug 10 13:30:51 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:30:54.006277 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-6d5bdf19-0186-437b-bb1a-926f4bd74c8c admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:54.007518 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-6d5bdf19-0186-437b-bb1a-926f4bd74c8c admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001923 Aug 10 13:30:54.009650 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 6/10] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 10 13:30:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:30:54.423962 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-a2945ba4-d794-42fd-8415-bc9d55e1e98c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 1024, "swap": 0, "name": "ds1G", "disk": 10}} {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:30:54.444773 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-a2945ba4-d794-42fd-8415-bc9d55e1e98c admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.429849 Aug 10 13:30:54.449265 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 5/11] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Aug 10 13:30:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 13:30:54.457989 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-be8aa49d-3afc-43f5-a1aa-0d6e0f2ba629 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:30:54.483335 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-be8aa49d-3afc-43f5-a1aa-0d6e0f2ba629 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029030 Aug 10 13:30:54.483940 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 7/12] 10.222.0.52 () {64 vars in 1336 bytes} [Wed Aug 10 13:30:54 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:30:56.659671 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-a2945ba4-d794-42fd-8415-bc9d55e1e98c admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:56.660689 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-a2945ba4-d794-42fd-8415-bc9d55e1e98c admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 10 13:30:56.661080 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 6/13] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 10 13:30:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:30:57.082599 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-3a9dd6b0-3c02-4c7d-b138-dba2359c5979 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds2G", "id": "d3", "vcpus": 2, "os-flavor-access:is_public": true, "disk": 10, "ram": 2048, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:30:57.109652 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-3a9dd6b0-3c02-4c7d-b138-dba2359c5979 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.442512 Aug 10 13:30:57.110204 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 8/14] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Aug 10 13:30:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 13:30:57.122384 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-692840f8-cb95-43c4-9ded-1109711603c3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:30:57.155313 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-692840f8-cb95-43c4-9ded-1109711603c3 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036702 Aug 10 13:30:57.155895 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 7/15] 10.222.0.52 () {64 vars in 1336 bytes} [Wed Aug 10 13:30:57 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:59.383610 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-3a9dd6b0-3c02-4c7d-b138-dba2359c5979 admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:59.384608 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-3a9dd6b0-3c02-4c7d-b138-dba2359c5979 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Aug 10 13:30:59.385006 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 9/16] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 10 13:30:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:30:59.808588 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-b08c1e62-49f6-45aa-b64a-f1fc579ee6ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d4", "swap": 0, "vcpus": 4, "os-flavor-access:is_public": true, "name": "ds4G", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:30:59.828141 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-b08c1e62-49f6-45aa-b64a-f1fc579ee6ff admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.436319 Aug 10 13:30:59.828738 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 8/17] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Aug 10 13:30:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 13:30:59.841156 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-11ee7043-1b33-46cf-9940-cc94b27548e3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:30:59.867791 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-11ee7043-1b33-46cf-9940-cc94b27548e3 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030684 Aug 10 13:30:59.868386 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 10/18] 10.222.0.52 () {64 vars in 1336 bytes} [Wed Aug 10 13:30:59 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:31:02.061579 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-b08c1e62-49f6-45aa-b64a-f1fc579ee6ff admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:02.063041 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-b08c1e62-49f6-45aa-b64a-f1fc579ee6ff admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002023 Aug 10 13:31:02.063532 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 9/19] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 10 13:31:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:02.480806 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-94c294cc-0d21-4679-a71b-ded484f2fbcf admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:02.505897 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-94c294cc-0d21-4679-a71b-ded484f2fbcf admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.435318 Aug 10 13:31:02.506361 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 11/20] 10.222.0.52 () {60 vars in 1292 bytes} [Wed Aug 10 13:31:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:31:04.716221 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-b08c1e62-49f6-45aa-b64a-f1fc579ee6ff admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:04.717159 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-b08c1e62-49f6-45aa-b64a-f1fc579ee6ff admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 10 13:31:04.717600 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 10/21] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 10 13:31:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:05.147717 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-b9bf77ff-1375-40c8-9318-c566d12c82c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "name": "m1.tiny", "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "disk": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:31:05.167694 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-b9bf77ff-1375-40c8-9318-c566d12c82c8 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.444204 Aug 10 13:31:05.168215 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 12/22] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Aug 10 13:31:04 2022] POST /compute/v2.1/flavors => generated 402 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 13:31:05.180141 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-933e7d30-4d1d-4736-ab77-2ae7c0f80781 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:31:05.205335 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-933e7d30-4d1d-4736-ab77-2ae7c0f80781 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028763 Aug 10 13:31:05.205927 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 11/23] 10.222.0.52 () {64 vars in 1333 bytes} [Wed Aug 10 13:31:05 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:31:07.460663 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-b9bf77ff-1375-40c8-9318-c566d12c82c8 admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:07.461700 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-b9bf77ff-1375-40c8-9318-c566d12c82c8 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 10 13:31:07.462247 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 13/24] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 10 13:31:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:07.865775 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-c0b2cb34-ea45-42e4-a7a7-1006480dabc0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "name": "m1.small", "os-flavor-access:is_public": true, "id": "2", "vcpus": 1, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:31:07.884344 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-c0b2cb34-ea45-42e4-a7a7-1006480dabc0 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.415738 Aug 10 13:31:07.891823 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 12/25] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Aug 10 13:31:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 13:31:07.897025 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-7901e787-6c23-428e-be86-10f3f26af05f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:31:07.921101 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-7901e787-6c23-428e-be86-10f3f26af05f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027718 Aug 10 13:31:07.921698 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 14/26] 10.222.0.52 () {64 vars in 1333 bytes} [Wed Aug 10 13:31:07 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:31:10.133209 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-c0b2cb34-ea45-42e4-a7a7-1006480dabc0 admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:10.134312 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-c0b2cb34-ea45-42e4-a7a7-1006480dabc0 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Aug 10 13:31:10.134716 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 13/27] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 10 13:31:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:10.563997 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-9b70cc54-16b0-4fba-abc5-9d0aea6abde7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "name": "m1.medium", "ram": 4096, "swap": 0, "disk": 40, "os-flavor-access:is_public": true, "id": "3", "rxtx_factor": 1.0}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:31:10.584096 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-9b70cc54-16b0-4fba-abc5-9d0aea6abde7 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.442834 Aug 10 13:31:10.584644 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 15/28] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Aug 10 13:31:10 2022] POST /compute/v2.1/flavors => generated 406 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 13:31:10.597041 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-8b67fa3d-742a-4bed-8fbc-694c6b6a4bbc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:31:10.622093 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-8b67fa3d-742a-4bed-8fbc-694c6b6a4bbc admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028760 Aug 10 13:31:10.622776 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 14/29] 10.222.0.52 () {64 vars in 1333 bytes} [Wed Aug 10 13:31:10 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:31:12.896727 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-9b70cc54-16b0-4fba-abc5-9d0aea6abde7 admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:12.900020 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-9b70cc54-16b0-4fba-abc5-9d0aea6abde7 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003743 Aug 10 13:31:12.901095 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 16/30] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 10 13:31:12 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:13.391107 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-eda4c0d0-d469-4d60-b730-8638aa445297 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "rxtx_factor": 1.0, "ram": 8192, "vcpus": 4, "os-flavor-access:is_public": true, "disk": 80, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large"}} {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:31:13.413712 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-eda4c0d0-d469-4d60-b730-8638aa445297 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.506421 Aug 10 13:31:13.414535 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 15/31] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Aug 10 13:31:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 13:31:13.426893 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-a0ffd707-6acb-4dbc-8a4e-18d872bb5eee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:31:13.452249 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-a0ffd707-6acb-4dbc-8a4e-18d872bb5eee admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028944 Aug 10 13:31:13.452821 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 17/32] 10.222.0.52 () {64 vars in 1333 bytes} [Wed Aug 10 13:31:13 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:31:15.667859 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-eda4c0d0-d469-4d60-b730-8638aa445297 admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:15.669560 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-eda4c0d0-d469-4d60-b730-8638aa445297 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002688 Aug 10 13:31:15.670183 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 16/33] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 10 13:31:15 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:16.117544 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-d8e1c780-75dc-4205-9463-1a9b69869e23 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "vcpus": 8, "id": "5", "ram": 16384}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:31:16.137284 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-d8e1c780-75dc-4205-9463-1a9b69869e23 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.460897 Aug 10 13:31:16.145219 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 18/34] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Aug 10 13:31:15 2022] POST /compute/v2.1/flavors => generated 408 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 13:31:16.150256 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-5f04fd8d-f2a8-4672-8664-bd2a0f62a48c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:31:16.155472 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG dbcounter [-] [103345] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:31:16.178645 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-5f04fd8d-f2a8-4672-8664-bd2a0f62a48c admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031509 Aug 10 13:31:16.179321 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 17/35] 10.222.0.52 () {64 vars in 1333 bytes} [Wed Aug 10 13:31:16 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:31:36.316778 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-d8e1c780-75dc-4205-9463-1a9b69869e23 admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:36.317823 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-d8e1c780-75dc-4205-9463-1a9b69869e23 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 10 13:31:36.318224 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 19/36] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 10 13:31:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:36.702075 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-ff202b5b-7056-4bf6-ad58-915c05f25456 admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:36.720809 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-ff202b5b-7056-4bf6-ad58-915c05f25456 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.396561 Aug 10 13:31:36.721357 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 18/37] 10.222.0.52 () {60 vars in 1292 bytes} [Wed Aug 10 13:31:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:31:37.791905 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-d8e1c780-75dc-4205-9463-1a9b69869e23 admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:37.793482 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-d8e1c780-75dc-4205-9463-1a9b69869e23 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 10 13:31:37.793875 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 20/38] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Aug 10 13:31:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:38.309427 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-1abb0f25-d1e6-4aa1-b3b6-9b82865b3d7f admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:38.315028 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO nova.api.openstack.wsgi [None req-1abb0f25-d1e6-4aa1-b3b6-9b82865b3d7f admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 10 13:31:38.318335 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-1abb0f25-d1e6-4aa1-b3b6-9b82865b3d7f admin admin] Request method failure captured: Aug 10 13:31:38.318335 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 10 13:31:38.318335 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: Accept: application/json Aug 10 13:31:38.318335 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: Accept-Encoding: gzip, deflate Aug 10 13:31:38.318335 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: Connection: keep-alive Aug 10 13:31:38.318335 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: Content-Length: 0 Aug 10 13:31:38.318335 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: Host: 10.222.0.52 Aug 10 13:31:38.318335 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: Openstack-Api-Version: compute 2.90 Aug 10 13:31:38.318335 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: Openstack-System-Scope: None Aug 10 13:31:38.318335 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: User-Agent: python-novaclient Aug 10 13:31:38.318335 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Auth-Token: gAAAAABi87M5ZxsnUaZYTkaKkZLhXkO5h_BK9sjazvOckIA2J4yc9Jfb6fo3FjAkgKG0sJ2lk9B3wQzGkYBbRQKBg9y98r7aq6Rozb1jXwiyAKC33DbzlSL1P5kkFA9uI0ETp44ear4mAIiCkJwPgpudFj3rXp7Er0heqGh-X-ThQVl84ojO1ZY Aug 10 13:31:38.318335 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Domain-Id: None Aug 10 13:31:38.318335 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Domain-Name: None Aug 10 13:31:38.318335 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Identity-Status: Confirmed Aug 10 13:31:38.318335 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Is-Admin-Project: True Aug 10 13:31:38.318335 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 13:31:38.318335 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Project-Domain-Id: default Aug 10 13:31:38.318335 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Project-Domain-Name: Default Aug 10 13:31:38.318335 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Project-Id: e7cfe98f92774b529ebade94e29001a3 Aug 10 13:31:38.318335 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Project-Name: admin Aug 10 13:31:38.318335 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Role: member,admin,reader Aug 10 13:31:38.318335 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Roles: member,admin,reader Aug 10 13:31:38.319827 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e7cfe98f92774b529ebade94e29001a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e7cfe98f92774b529ebade94e29001a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e7cfe98f92774b529ebade94e29001a3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e7cfe98f92774b529ebade94e29001a3"}]}] Aug 10 13:31:38.319827 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Tenant: admin Aug 10 13:31:38.319827 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Tenant-Id: e7cfe98f92774b529ebade94e29001a3 Aug 10 13:31:38.319827 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Tenant-Name: admin Aug 10 13:31:38.319827 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-User: admin Aug 10 13:31:38.319827 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-User-Domain-Id: default Aug 10 13:31:38.319827 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-User-Domain-Name: Default Aug 10 13:31:38.319827 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-User-Id: 1d95623897cc4c628d91416fe290bfa2 Aug 10 13:31:38.319827 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-User-Name: admin Aug 10 13:31:38.319827 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: method: > Aug 10 13:31:38.319827 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: exception: Flavor 42 could not be found. Aug 10 13:31:38.319827 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: action_args: {'id': '42'} Aug 10 13:31:38.319827 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:31:38.319827 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:38.320809 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 13:31:38.320809 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 13:31:38.320809 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 13:31:38.320809 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 13:31:38.320809 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 13:31:38.320809 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 13:31:38.320809 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 13:31:38.320809 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 13:31:38.320809 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 13:31:38.320809 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:31:38.320809 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 13:31:38.320809 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 13:31:38.320809 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 10 13:31:38.320809 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Aug 10 13:31:38.320809 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:31:38.320809 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Aug 10 13:31:38.320809 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:38.320809 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:31:38.320809 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:31:38.322340 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:31:38.322340 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:31:38.322340 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:31:38.322340 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:31:38.322340 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 13:31:38.322340 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:31:38.322340 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 10 13:31:38.322340 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Aug 10 13:31:38.322340 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:31:38.322340 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Aug 10 13:31:38.322340 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:38.322340 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:31:38.322340 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:31:38.322340 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:31:38.322340 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:31:38.322340 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 10 13:31:38.322340 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Aug 10 13:31:38.322340 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-1abb0f25-d1e6-4aa1-b3b6-9b82865b3d7f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:31:38.323668 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-1abb0f25-d1e6-4aa1-b3b6-9b82865b3d7f admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.389393 Aug 10 13:31:38.323668 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 19/39] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Aug 10 13:31:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 13:31:38.329950 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-300c79fa-ca05-405a-93df-37402c3ad731 admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:38.334150 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:31:38.353030 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-300c79fa-ca05-405a-93df-37402c3ad731 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026615 Aug 10 13:31:38.353588 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 21/40] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Aug 10 13:31:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:31:38.364564 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-770cc3d5-86dc-40bb-844d-945e5c059ee2 admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:38.390093 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-770cc3d5-86dc-40bb-844d-945e5c059ee2 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029075 Aug 10 13:31:38.390675 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 20/41] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Aug 10 13:31:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:31:38.400284 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-cd29f906-04b2-4fc8-bfc2-04c27262b6da admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:38.406843 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.wsgi [None req-cd29f906-04b2-4fc8-bfc2-04c27262b6da admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 10 13:31:38.410097 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-cd29f906-04b2-4fc8-bfc2-04c27262b6da admin admin] Request method failure captured: Aug 10 13:31:38.410097 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 10 13:31:38.410097 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: Accept: application/json Aug 10 13:31:38.410097 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: Accept-Encoding: gzip, deflate Aug 10 13:31:38.410097 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: Connection: keep-alive Aug 10 13:31:38.410097 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: Content-Length: 0 Aug 10 13:31:38.410097 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: Host: 10.222.0.52 Aug 10 13:31:38.410097 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: Openstack-Api-Version: compute 2.90 Aug 10 13:31:38.410097 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: Openstack-System-Scope: None Aug 10 13:31:38.410097 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: User-Agent: python-novaclient Aug 10 13:31:38.410097 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Auth-Token: gAAAAABi87M5ZxsnUaZYTkaKkZLhXkO5h_BK9sjazvOckIA2J4yc9Jfb6fo3FjAkgKG0sJ2lk9B3wQzGkYBbRQKBg9y98r7aq6Rozb1jXwiyAKC33DbzlSL1P5kkFA9uI0ETp44ear4mAIiCkJwPgpudFj3rXp7Er0heqGh-X-ThQVl84ojO1ZY Aug 10 13:31:38.410097 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Domain-Id: None Aug 10 13:31:38.410097 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Domain-Name: None Aug 10 13:31:38.410097 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Identity-Status: Confirmed Aug 10 13:31:38.410097 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Is-Admin-Project: True Aug 10 13:31:38.410097 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 13:31:38.410097 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Project-Domain-Id: default Aug 10 13:31:38.410097 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Project-Domain-Name: Default Aug 10 13:31:38.410097 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Project-Id: e7cfe98f92774b529ebade94e29001a3 Aug 10 13:31:38.410097 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Project-Name: admin Aug 10 13:31:38.410097 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Role: member,admin,reader Aug 10 13:31:38.410097 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Roles: member,admin,reader Aug 10 13:31:38.411621 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e7cfe98f92774b529ebade94e29001a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e7cfe98f92774b529ebade94e29001a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e7cfe98f92774b529ebade94e29001a3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e7cfe98f92774b529ebade94e29001a3"}]}] Aug 10 13:31:38.411621 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Tenant: admin Aug 10 13:31:38.411621 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Tenant-Id: e7cfe98f92774b529ebade94e29001a3 Aug 10 13:31:38.411621 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Tenant-Name: admin Aug 10 13:31:38.411621 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-User: admin Aug 10 13:31:38.411621 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-User-Domain-Id: default Aug 10 13:31:38.411621 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-User-Domain-Name: Default Aug 10 13:31:38.411621 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-User-Id: 1d95623897cc4c628d91416fe290bfa2 Aug 10 13:31:38.411621 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-User-Name: admin Aug 10 13:31:38.411621 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: method: > Aug 10 13:31:38.411621 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: exception: Flavor 42 could not be found. Aug 10 13:31:38.411621 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: action_args: {'id': '42'} Aug 10 13:31:38.411621 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:31:38.411621 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:38.412575 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 13:31:38.412575 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 13:31:38.412575 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 13:31:38.412575 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 13:31:38.412575 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 13:31:38.412575 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 13:31:38.412575 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 13:31:38.412575 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 13:31:38.412575 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 13:31:38.412575 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:31:38.412575 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 13:31:38.412575 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 13:31:38.412575 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 10 13:31:38.412575 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Aug 10 13:31:38.412575 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:31:38.412575 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Aug 10 13:31:38.412575 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:38.412575 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:31:38.412575 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:31:38.413892 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:31:38.413892 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:31:38.413892 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:31:38.413892 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:31:38.413892 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 13:31:38.413892 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:31:38.413892 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 10 13:31:38.413892 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Aug 10 13:31:38.413892 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:31:38.413892 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Aug 10 13:31:38.413892 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:38.413892 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:31:38.413892 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:31:38.413892 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:31:38.413892 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:31:38.413892 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 10 13:31:38.413892 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Aug 10 13:31:38.413892 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-cd29f906-04b2-4fc8-bfc2-04c27262b6da admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:31:38.415141 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-cd29f906-04b2-4fc8-bfc2-04c27262b6da admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014750 Aug 10 13:31:38.415141 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 22/42] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Aug 10 13:31:38 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 13:31:39.372482 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-770cc3d5-86dc-40bb-844d-945e5c059ee2 admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:39.373548 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-770cc3d5-86dc-40bb-844d-945e5c059ee2 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Aug 10 13:31:39.373946 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 21/43] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Aug 10 13:31:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:39.913157 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-83276bb2-97d5-49b1-b2a2-b66ad781538f admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:39.918552 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.wsgi [None req-83276bb2-97d5-49b1-b2a2-b66ad781538f admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 10 13:31:39.920063 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-83276bb2-97d5-49b1-b2a2-b66ad781538f admin admin] Request method failure captured: Aug 10 13:31:39.920063 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 10 13:31:39.920063 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: Accept: application/json Aug 10 13:31:39.920063 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: Accept-Encoding: gzip, deflate Aug 10 13:31:39.920063 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: Connection: keep-alive Aug 10 13:31:39.920063 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: Content-Length: 0 Aug 10 13:31:39.920063 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: Host: 10.222.0.52 Aug 10 13:31:39.920063 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: Openstack-Api-Version: compute 2.90 Aug 10 13:31:39.920063 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: Openstack-System-Scope: None Aug 10 13:31:39.920063 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: User-Agent: python-novaclient Aug 10 13:31:39.920063 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Auth-Token: gAAAAABi87M7qHsHPi_GOkzLDoIrYP4VXC1w5OSYtyUYdCefesZRubqMtqBLjNyxT5UgJ2dm3KlAOVs1CrkNHmmHVFbv0AB3L_nQS49D_fD39MhjSwbVmd_DHG098rvhSjQOE42wysyTz2Ygcd0wjA1PspfaShGwkpVm8xjXQ34MZYzCQq82tIk Aug 10 13:31:39.920063 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Domain-Id: None Aug 10 13:31:39.920063 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Domain-Name: None Aug 10 13:31:39.920063 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Identity-Status: Confirmed Aug 10 13:31:39.920063 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Is-Admin-Project: True Aug 10 13:31:39.920063 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 13:31:39.920063 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Project-Domain-Id: default Aug 10 13:31:39.920063 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Project-Domain-Name: Default Aug 10 13:31:39.920063 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Project-Id: e7cfe98f92774b529ebade94e29001a3 Aug 10 13:31:39.920063 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Project-Name: admin Aug 10 13:31:39.920063 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Role: member,admin,reader Aug 10 13:31:39.920063 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Roles: member,admin,reader Aug 10 13:31:39.921598 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e7cfe98f92774b529ebade94e29001a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e7cfe98f92774b529ebade94e29001a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e7cfe98f92774b529ebade94e29001a3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e7cfe98f92774b529ebade94e29001a3"}]}] Aug 10 13:31:39.921598 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Tenant: admin Aug 10 13:31:39.921598 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Tenant-Id: e7cfe98f92774b529ebade94e29001a3 Aug 10 13:31:39.921598 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Tenant-Name: admin Aug 10 13:31:39.921598 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-User: admin Aug 10 13:31:39.921598 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-User-Domain-Id: default Aug 10 13:31:39.921598 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-User-Domain-Name: Default Aug 10 13:31:39.921598 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-User-Id: 1d95623897cc4c628d91416fe290bfa2 Aug 10 13:31:39.921598 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-User-Name: admin Aug 10 13:31:39.921598 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: method: > Aug 10 13:31:39.921598 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: exception: Flavor 84 could not be found. Aug 10 13:31:39.921598 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: action_args: {'id': '84'} Aug 10 13:31:39.921598 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:31:39.921598 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:39.922578 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 13:31:39.922578 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 13:31:39.922578 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 13:31:39.922578 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 13:31:39.922578 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 13:31:39.922578 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 13:31:39.922578 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 13:31:39.922578 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 13:31:39.922578 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 13:31:39.922578 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:31:39.922578 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 13:31:39.922578 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 13:31:39.922578 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 10 13:31:39.922578 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Aug 10 13:31:39.922578 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:31:39.922578 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Aug 10 13:31:39.922578 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:39.922578 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:31:39.922578 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:31:39.923720 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:31:39.923720 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:31:39.923720 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:31:39.923720 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:31:39.923720 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 13:31:39.923720 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:31:39.923720 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 10 13:31:39.923720 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Aug 10 13:31:39.923720 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:31:39.923720 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Aug 10 13:31:39.923720 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:39.923720 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:31:39.923720 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:31:39.923720 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:31:39.923720 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:31:39.923720 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 10 13:31:39.923720 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Aug 10 13:31:39.923720 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-83276bb2-97d5-49b1-b2a2-b66ad781538f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:31:39.924706 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-83276bb2-97d5-49b1-b2a2-b66ad781538f admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.406354 Aug 10 13:31:39.924706 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 23/44] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Aug 10 13:31:39 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 407 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 13:31:39.930967 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-c238968b-1b3d-482c-b6df-67e5f70d5518 admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:39.945513 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-c238968b-1b3d-482c-b6df-67e5f70d5518 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018055 Aug 10 13:31:39.946029 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 22/45] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Aug 10 13:31:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:31:39.955349 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-cd7180b9-fd73-4905-bf5d-b23764bb9cdc admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:39.971049 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-cd7180b9-fd73-4905-bf5d-b23764bb9cdc admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019063 Aug 10 13:31:39.971561 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 24/46] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Aug 10 13:31:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:31:39.980288 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-07ae7567-53ed-44bb-9562-b86f29c4b3f5 admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:39.985708 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO nova.api.openstack.wsgi [None req-07ae7567-53ed-44bb-9562-b86f29c4b3f5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 10 13:31:39.987243 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-07ae7567-53ed-44bb-9562-b86f29c4b3f5 admin admin] Request method failure captured: Aug 10 13:31:39.987243 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 10 13:31:39.987243 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: Accept: application/json Aug 10 13:31:39.987243 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: Accept-Encoding: gzip, deflate Aug 10 13:31:39.987243 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: Connection: keep-alive Aug 10 13:31:39.987243 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: Content-Length: 0 Aug 10 13:31:39.987243 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: Host: 10.222.0.52 Aug 10 13:31:39.987243 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: Openstack-Api-Version: compute 2.90 Aug 10 13:31:39.987243 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: Openstack-System-Scope: None Aug 10 13:31:39.987243 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: User-Agent: python-novaclient Aug 10 13:31:39.987243 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Auth-Token: gAAAAABi87M7qHsHPi_GOkzLDoIrYP4VXC1w5OSYtyUYdCefesZRubqMtqBLjNyxT5UgJ2dm3KlAOVs1CrkNHmmHVFbv0AB3L_nQS49D_fD39MhjSwbVmd_DHG098rvhSjQOE42wysyTz2Ygcd0wjA1PspfaShGwkpVm8xjXQ34MZYzCQq82tIk Aug 10 13:31:39.987243 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Domain-Id: None Aug 10 13:31:39.987243 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Domain-Name: None Aug 10 13:31:39.987243 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Identity-Status: Confirmed Aug 10 13:31:39.987243 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Is-Admin-Project: True Aug 10 13:31:39.987243 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 13:31:39.987243 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Project-Domain-Id: default Aug 10 13:31:39.987243 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Project-Domain-Name: Default Aug 10 13:31:39.987243 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Project-Id: e7cfe98f92774b529ebade94e29001a3 Aug 10 13:31:39.987243 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Project-Name: admin Aug 10 13:31:39.987243 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Role: member,admin,reader Aug 10 13:31:39.987243 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Roles: member,admin,reader Aug 10 13:31:39.988777 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e7cfe98f92774b529ebade94e29001a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e7cfe98f92774b529ebade94e29001a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e7cfe98f92774b529ebade94e29001a3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e7cfe98f92774b529ebade94e29001a3"}]}] Aug 10 13:31:39.988777 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Tenant: admin Aug 10 13:31:39.988777 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Tenant-Id: e7cfe98f92774b529ebade94e29001a3 Aug 10 13:31:39.988777 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Tenant-Name: admin Aug 10 13:31:39.988777 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-User: admin Aug 10 13:31:39.988777 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-User-Domain-Id: default Aug 10 13:31:39.988777 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-User-Domain-Name: Default Aug 10 13:31:39.988777 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-User-Id: 1d95623897cc4c628d91416fe290bfa2 Aug 10 13:31:39.988777 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-User-Name: admin Aug 10 13:31:39.988777 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: method: > Aug 10 13:31:39.988777 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: exception: Flavor 84 could not be found. Aug 10 13:31:39.988777 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: action_args: {'id': '84'} Aug 10 13:31:39.988777 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:31:39.988777 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:39.989862 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 13:31:39.989862 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 13:31:39.989862 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 13:31:39.989862 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 13:31:39.989862 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 13:31:39.989862 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 13:31:39.989862 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 13:31:39.989862 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 13:31:39.989862 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 13:31:39.989862 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:31:39.989862 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 13:31:39.989862 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 13:31:39.989862 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 10 13:31:39.989862 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Aug 10 13:31:39.989862 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:31:39.989862 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Aug 10 13:31:39.989862 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:39.989862 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:31:39.989862 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:31:39.991346 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:31:39.991346 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:31:39.991346 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:31:39.991346 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:31:39.991346 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 13:31:39.991346 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:31:39.991346 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 10 13:31:39.991346 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Aug 10 13:31:39.991346 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:31:39.991346 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Aug 10 13:31:39.991346 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:39.991346 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:31:39.991346 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:31:39.991346 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:31:39.991346 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:31:39.991346 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 10 13:31:39.991346 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Aug 10 13:31:39.991346 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-07ae7567-53ed-44bb-9562-b86f29c4b3f5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:31:39.992576 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-07ae7567-53ed-44bb-9562-b86f29c4b3f5 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011698 Aug 10 13:31:39.992576 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 23/47] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Aug 10 13:31:39 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 13:31:40.956137 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-cd7180b9-fd73-4905-bf5d-b23764bb9cdc admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:40.957156 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-cd7180b9-fd73-4905-bf5d-b23764bb9cdc admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 10 13:31:40.957580 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 25/48] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Aug 10 13:31:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:41.469114 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-19f9f4ae-3a53-48b4-a757-f47303bbd6d3 admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:41.474804 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO nova.api.openstack.wsgi [None req-19f9f4ae-3a53-48b4-a757-f47303bbd6d3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 10 13:31:41.476299 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-19f9f4ae-3a53-48b4-a757-f47303bbd6d3 admin admin] Request method failure captured: Aug 10 13:31:41.476299 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 10 13:31:41.476299 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: Accept: application/json Aug 10 13:31:41.476299 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: Accept-Encoding: gzip, deflate Aug 10 13:31:41.476299 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: Connection: keep-alive Aug 10 13:31:41.476299 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: Content-Length: 0 Aug 10 13:31:41.476299 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: Host: 10.222.0.52 Aug 10 13:31:41.476299 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: Openstack-Api-Version: compute 2.90 Aug 10 13:31:41.476299 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: Openstack-System-Scope: None Aug 10 13:31:41.476299 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: User-Agent: python-novaclient Aug 10 13:31:41.476299 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Auth-Token: gAAAAABi87M82vnnPxCQ3iagpDGMTB40G4UdtJU8Uckmt-BwQDofP-o-2Tnz3FQeiKJIbR-QECdT-cdXEjwy0tU7QtrU-tIITWJ-wr8-Wks8iH_1P61g2qJ8W4ymvimTSvsuH0rhJtbKjfrSweQYpdMb2JR8bZOuzcXIlqb04rdN--MyCxyw42M Aug 10 13:31:41.476299 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Domain-Id: None Aug 10 13:31:41.476299 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Domain-Name: None Aug 10 13:31:41.476299 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Identity-Status: Confirmed Aug 10 13:31:41.476299 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Is-Admin-Project: True Aug 10 13:31:41.476299 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 13:31:41.476299 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Project-Domain-Id: default Aug 10 13:31:41.476299 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Project-Domain-Name: Default Aug 10 13:31:41.476299 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Project-Id: e7cfe98f92774b529ebade94e29001a3 Aug 10 13:31:41.476299 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Project-Name: admin Aug 10 13:31:41.476299 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Role: member,admin,reader Aug 10 13:31:41.476299 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Roles: member,admin,reader Aug 10 13:31:41.477860 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e7cfe98f92774b529ebade94e29001a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e7cfe98f92774b529ebade94e29001a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e7cfe98f92774b529ebade94e29001a3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e7cfe98f92774b529ebade94e29001a3"}]}] Aug 10 13:31:41.477860 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Tenant: admin Aug 10 13:31:41.477860 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Tenant-Id: e7cfe98f92774b529ebade94e29001a3 Aug 10 13:31:41.477860 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-Tenant-Name: admin Aug 10 13:31:41.477860 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-User: admin Aug 10 13:31:41.477860 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-User-Domain-Id: default Aug 10 13:31:41.477860 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-User-Domain-Name: Default Aug 10 13:31:41.477860 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-User-Id: 1d95623897cc4c628d91416fe290bfa2 Aug 10 13:31:41.477860 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: X-User-Name: admin Aug 10 13:31:41.477860 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: method: > Aug 10 13:31:41.477860 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: exception: Flavor 451 could not be found. Aug 10 13:31:41.477860 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: action_args: {'id': '451'} Aug 10 13:31:41.477860 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:31:41.477860 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:41.478760 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 13:31:41.478760 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 13:31:41.478760 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 13:31:41.478760 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 13:31:41.478760 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 13:31:41.478760 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 13:31:41.478760 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 13:31:41.478760 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 13:31:41.478760 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 13:31:41.478760 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:31:41.478760 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 13:31:41.478760 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 13:31:41.478760 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 10 13:31:41.478760 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Aug 10 13:31:41.478760 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:31:41.478760 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Aug 10 13:31:41.478760 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:41.478760 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:31:41.478760 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:31:41.480071 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:31:41.480071 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:31:41.480071 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:31:41.480071 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:31:41.480071 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 13:31:41.480071 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:31:41.480071 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 10 13:31:41.480071 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Aug 10 13:31:41.480071 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:31:41.480071 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Aug 10 13:31:41.480071 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:41.480071 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:31:41.480071 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:31:41.480071 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:31:41.480071 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:31:41.480071 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 10 13:31:41.480071 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Aug 10 13:31:41.480071 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-19f9f4ae-3a53-48b4-a757-f47303bbd6d3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:31:41.481904 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-19f9f4ae-3a53-48b4-a757-f47303bbd6d3 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.384652 Aug 10 13:31:41.481904 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 24/49] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Aug 10 13:31:41 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 386 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 13:31:41.488169 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-9c3c6be2-1650-4a3a-a355-10b3c7e2356d admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:41.503633 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-9c3c6be2-1650-4a3a-a355-10b3c7e2356d admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019096 Aug 10 13:31:41.504148 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 26/50] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Aug 10 13:31:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:31:41.513495 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-c0100591-8c0f-4659-81aa-1a625b72c8e2 admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:41.528150 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-c0100591-8c0f-4659-81aa-1a625b72c8e2 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018246 Aug 10 13:31:41.528674 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 25/51] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Aug 10 13:31:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:31:41.537448 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-bbb8c724-e67b-4600-8ef2-bfcb8ab67ffb admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:41.542692 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.wsgi [None req-bbb8c724-e67b-4600-8ef2-bfcb8ab67ffb admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 10 13:31:41.544656 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-bbb8c724-e67b-4600-8ef2-bfcb8ab67ffb admin admin] Request method failure captured: Aug 10 13:31:41.544656 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 10 13:31:41.544656 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: Accept: application/json Aug 10 13:31:41.544656 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: Accept-Encoding: gzip, deflate Aug 10 13:31:41.544656 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: Connection: keep-alive Aug 10 13:31:41.544656 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: Content-Length: 0 Aug 10 13:31:41.544656 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: Host: 10.222.0.52 Aug 10 13:31:41.544656 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: Openstack-Api-Version: compute 2.90 Aug 10 13:31:41.544656 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: Openstack-System-Scope: None Aug 10 13:31:41.544656 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: User-Agent: python-novaclient Aug 10 13:31:41.544656 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Auth-Token: gAAAAABi87M82vnnPxCQ3iagpDGMTB40G4UdtJU8Uckmt-BwQDofP-o-2Tnz3FQeiKJIbR-QECdT-cdXEjwy0tU7QtrU-tIITWJ-wr8-Wks8iH_1P61g2qJ8W4ymvimTSvsuH0rhJtbKjfrSweQYpdMb2JR8bZOuzcXIlqb04rdN--MyCxyw42M Aug 10 13:31:41.544656 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Domain-Id: None Aug 10 13:31:41.544656 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Domain-Name: None Aug 10 13:31:41.544656 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Identity-Status: Confirmed Aug 10 13:31:41.544656 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Is-Admin-Project: True Aug 10 13:31:41.544656 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 13:31:41.544656 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Project-Domain-Id: default Aug 10 13:31:41.544656 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Project-Domain-Name: Default Aug 10 13:31:41.544656 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Project-Id: e7cfe98f92774b529ebade94e29001a3 Aug 10 13:31:41.544656 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Project-Name: admin Aug 10 13:31:41.544656 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Role: member,admin,reader Aug 10 13:31:41.544656 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Roles: member,admin,reader Aug 10 13:31:41.546296 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e7cfe98f92774b529ebade94e29001a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e7cfe98f92774b529ebade94e29001a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e7cfe98f92774b529ebade94e29001a3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e7cfe98f92774b529ebade94e29001a3"}]}] Aug 10 13:31:41.546296 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Tenant: admin Aug 10 13:31:41.546296 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Tenant-Id: e7cfe98f92774b529ebade94e29001a3 Aug 10 13:31:41.546296 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-Tenant-Name: admin Aug 10 13:31:41.546296 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-User: admin Aug 10 13:31:41.546296 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-User-Domain-Id: default Aug 10 13:31:41.546296 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-User-Domain-Name: Default Aug 10 13:31:41.546296 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-User-Id: 1d95623897cc4c628d91416fe290bfa2 Aug 10 13:31:41.546296 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: X-User-Name: admin Aug 10 13:31:41.546296 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: method: > Aug 10 13:31:41.546296 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: exception: Flavor 451 could not be found. Aug 10 13:31:41.546296 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: action_args: {'id': '451'} Aug 10 13:31:41.546296 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:31:41.546296 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:41.547109 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 13:31:41.547109 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 13:31:41.547109 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 13:31:41.547109 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 13:31:41.547109 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 13:31:41.547109 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 13:31:41.547109 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 13:31:41.547109 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 13:31:41.547109 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 13:31:41.547109 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:31:41.547109 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 13:31:41.547109 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 13:31:41.547109 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 10 13:31:41.547109 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Aug 10 13:31:41.547109 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:31:41.547109 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Aug 10 13:31:41.547109 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:41.547109 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:31:41.547109 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:31:41.548226 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:31:41.548226 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:31:41.548226 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:31:41.548226 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:31:41.548226 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 13:31:41.548226 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:31:41.548226 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 10 13:31:41.548226 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Aug 10 13:31:41.548226 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:31:41.548226 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Aug 10 13:31:41.548226 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:31:41.548226 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:31:41.548226 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:31:41.548226 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:31:41.548226 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:31:41.548226 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 10 13:31:41.548226 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Aug 10 13:31:41.548226 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-bbb8c724-e67b-4600-8ef2-bfcb8ab67ffb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:31:41.549217 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-bbb8c724-e67b-4600-8ef2-bfcb8ab67ffb admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011960 Aug 10 13:31:41.549217 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 27/52] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Aug 10 13:31:41 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 13:31:42.505840 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-c0100591-8c0f-4659-81aa-1a625b72c8e2 admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:42.506865 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-c0100591-8c0f-4659-81aa-1a625b72c8e2 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Aug 10 13:31:42.507247 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 26/53] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Aug 10 13:31:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:43.021355 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-a91403b8-ff02-44f7-a2bf-50b7fee64d08 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:31:43.039426 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-a91403b8-ff02-44f7-a2bf-50b7fee64d08 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.394952 Aug 10 13:31:43.039949 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 28/54] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Aug 10 13:31:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 13:31:43.999921 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-c0100591-8c0f-4659-81aa-1a625b72c8e2 admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:44.000932 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-c0100591-8c0f-4659-81aa-1a625b72c8e2 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Aug 10 13:31:44.001360 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 27/55] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Aug 10 13:31:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:44.524499 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-ff8441f8-92ff-4f05-b228-b4c0e827675a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:31:44.543180 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-ff8441f8-92ff-4f05-b228-b4c0e827675a admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.401374 Aug 10 13:31:44.543716 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 29/56] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Aug 10 13:31:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 13:31:45.507785 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-c0100591-8c0f-4659-81aa-1a625b72c8e2 admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:45.508782 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-c0100591-8c0f-4659-81aa-1a625b72c8e2 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Aug 10 13:31:45.509173 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 28/57] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Aug 10 13:31:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:46.029868 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-05b19186-d0c4-49ff-a9b7-d46b79d395ce admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:31:46.048710 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-05b19186-d0c4-49ff-a9b7-d46b79d395ce admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.401570 Aug 10 13:31:46.049266 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 30/58] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Aug 10 13:31:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 13:31:47.138276 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-c0100591-8c0f-4659-81aa-1a625b72c8e2 admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:47.139281 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-c0100591-8c0f-4659-81aa-1a625b72c8e2 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Aug 10 13:31:47.139673 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 29/59] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Aug 10 13:31:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:31:47.656697 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-745dc37c-601b-4eac-b8b3-6b0a0bc62450 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:31:47.674932 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-745dc37c-601b-4eac-b8b3-6b0a0bc62450 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.395365 Aug 10 13:31:47.675472 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 31/60] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Aug 10 13:31:47 2022] POST /compute/v2.1/flavors => generated 409 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 13:31:48.643717 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-c0100591-8c0f-4659-81aa-1a625b72c8e2 admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:48.644763 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-c0100591-8c0f-4659-81aa-1a625b72c8e2 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 10 13:31:48.645157 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 30/61] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Aug 10 13:31:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:31:49.157724 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-fa30aa7c-c146-4cfd-aefe-3fbc485557ed admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:31:49.178116 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-fa30aa7c-c146-4cfd-aefe-3fbc485557ed admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.396145 Aug 10 13:31:49.178647 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 32/62] 10.222.0.52 () {60 vars in 1202 bytes} [Wed Aug 10 13:31:48 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:32:40.631072 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-c0100591-8c0f-4659-81aa-1a625b72c8e2 admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:40.632072 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-c0100591-8c0f-4659-81aa-1a625b72c8e2 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Aug 10 13:32:40.632472 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 31/63] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 10 13:32:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:32:40.642977 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:32:41.017919 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-501f7eb1-8dff-4f4a-9285-995094fead8b admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:41.038288 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-501f7eb1-8dff-4f4a-9285-995094fead8b admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.399898 Aug 10 13:32:41.038830 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 33/64] 10.222.0.52 () {60 vars in 1292 bytes} [Wed Aug 10 13:32:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:32:41.062097 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-5c685c35-6a61-4022-8a15-fa560fb9dfd5 admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:41.065645 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG dbcounter [-] [103345] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:32:41.071735 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-5c685c35-6a61-4022-8a15-fa560fb9dfd5 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013247 Aug 10 13:32:41.072398 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 32/65] 10.222.0.52 () {60 vars in 1283 bytes} [Wed Aug 10 13:32:41 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:32:41.083797 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-6a04b716-025e-40fb-86b8-5717ef85f94f admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:41.091747 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-6a04b716-025e-40fb-86b8-5717ef85f94f admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011452 Aug 10 13:32:41.092254 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 34/66] 10.222.0.52 () {60 vars in 1286 bytes} [Wed Aug 10 13:32:41 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:32:41.103688 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-39c3f6d0-4c7c-475c-9247-1f1556bb9fba admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:41.112250 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-39c3f6d0-4c7c-475c-9247-1f1556bb9fba admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012413 Aug 10 13:32:41.112761 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 33/67] 10.222.0.52 () {60 vars in 1286 bytes} [Wed Aug 10 13:32:41 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:32:41.124010 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-2bc9f5be-e345-4fce-aba0-d7ea9f8788ec admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:32:41.131582 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-2bc9f5be-e345-4fce-aba0-d7ea9f8788ec admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011149 Aug 10 13:32:41.132081 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 35/68] 10.222.0.52 () {60 vars in 1283 bytes} [Wed Aug 10 13:32:41 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:35:33.790756 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-39c3f6d0-4c7c-475c-9247-1f1556bb9fba admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:35:33.791761 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-39c3f6d0-4c7c-475c-9247-1f1556bb9fba admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 10 13:35:33.792149 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 34/69] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Aug 10 13:35:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:35:33.930995 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writing DB stats nova_api:SELECT=6 {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:35:34.086910 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-20088322-dbab-4ace-a9bc-702842f692b0 admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:35:34.089261 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 13:35:34.089261 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: warnings.warn(msg) Aug 10 13:35:34.090366 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-20088322-dbab-4ace-a9bc-702842f692b0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:35:34.090835 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-20088322-dbab-4ace-a9bc-702842f692b0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:35:34.091252 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-20088322-dbab-4ace-a9bc-702842f692b0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:35:34.091951 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-20088322-dbab-4ace-a9bc-702842f692b0 admin admin] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:35:34.092389 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-20088322-dbab-4ace-a9bc-702842f692b0 admin admin] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:35:34.092793 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-20088322-dbab-4ace-a9bc-702842f692b0 admin admin] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:35:34.132767 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-20088322-dbab-4ace-a9bc-702842f692b0 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.202981 Aug 10 13:35:34.133638 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 36/70] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Aug 10 13:35:33 2022] GET /compute/v2.1/os-services => generated 791 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 13:35:34.964793 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-39c3f6d0-4c7c-475c-9247-1f1556bb9fba admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:35:34.965842 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-39c3f6d0-4c7c-475c-9247-1f1556bb9fba admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 10 13:35:34.966230 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 35/71] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Aug 10 13:35:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:35:35.158274 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-82e3d45b-845e-47d8-924e-dc0decd0a8d0 admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:35:35.160631 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 13:35:35.160631 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: warnings.warn(msg) Aug 10 13:35:35.161756 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-82e3d45b-845e-47d8-924e-dc0decd0a8d0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:35:35.162230 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-82e3d45b-845e-47d8-924e-dc0decd0a8d0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:35:35.162672 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-82e3d45b-845e-47d8-924e-dc0decd0a8d0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:35:35.163395 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-82e3d45b-845e-47d8-924e-dc0decd0a8d0 admin admin] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:35:35.163839 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-82e3d45b-845e-47d8-924e-dc0decd0a8d0 admin admin] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:35:35.164255 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-82e3d45b-845e-47d8-924e-dc0decd0a8d0 admin admin] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:35:35.184726 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-82e3d45b-845e-47d8-924e-dc0decd0a8d0 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077690 Aug 10 13:35:35.185211 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 37/72] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Aug 10 13:35:35 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 13:35:46.437438 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-39c3f6d0-4c7c-475c-9247-1f1556bb9fba admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:35:46.438435 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-39c3f6d0-4c7c-475c-9247-1f1556bb9fba admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Aug 10 13:35:46.438823 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 36/73] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Aug 10 13:35:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:35:46.585143 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writing DB stats nova_cell0:SELECT=4 {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:35:46.585803 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writing DB stats nova_cell1:SELECT=4 {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:35:46.586442 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writing DB stats nova_api:SELECT=8 {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:35:46.635316 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-353d646a-2642-4661-8c20-ed973198218e admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:35:46.637968 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 13:35:46.637968 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: warnings.warn(msg) Aug 10 13:35:46.639207 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-353d646a-2642-4661-8c20-ed973198218e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:35:46.639748 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-353d646a-2642-4661-8c20-ed973198218e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:35:46.640276 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-353d646a-2642-4661-8c20-ed973198218e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:35:46.640941 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-353d646a-2642-4661-8c20-ed973198218e admin admin] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:35:46.641410 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-353d646a-2642-4661-8c20-ed973198218e admin admin] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:35:46.641817 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-353d646a-2642-4661-8c20-ed973198218e admin admin] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:35:46.666852 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-353d646a-2642-4661-8c20-ed973198218e admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.086251 Aug 10 13:35:46.667400 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 38/74] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Aug 10 13:35:46 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:35:47.488667 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-39c3f6d0-4c7c-475c-9247-1f1556bb9fba admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:35:47.489790 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-39c3f6d0-4c7c-475c-9247-1f1556bb9fba admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Aug 10 13:35:47.490202 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 37/75] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Aug 10 13:35:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:35:47.681779 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-a667cbae-d301-4dee-b37c-531c2ddce869 admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:35:47.684186 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 13:35:47.684186 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: warnings.warn(msg) Aug 10 13:35:47.685278 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-a667cbae-d301-4dee-b37c-531c2ddce869 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:35:47.685751 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-a667cbae-d301-4dee-b37c-531c2ddce869 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:35:47.686198 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-a667cbae-d301-4dee-b37c-531c2ddce869 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:35:47.686894 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-a667cbae-d301-4dee-b37c-531c2ddce869 admin admin] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:35:47.687327 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-a667cbae-d301-4dee-b37c-531c2ddce869 admin admin] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:35:47.687733 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-a667cbae-d301-4dee-b37c-531c2ddce869 admin admin] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:35:47.708501 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-a667cbae-d301-4dee-b37c-531c2ddce869 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077826 Aug 10 13:35:47.709033 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 39/76] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Aug 10 13:35:47 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:36:45.336735 dv-cinder-852009-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 10 13:36:45.338248 dv-cinder-852009-3-iscsi devstack@n-api.service[103343]: Wed Aug 10 13:36:45 2022 - graceful shutdown triggered... Aug 10 13:36:45.338739 dv-cinder-852009-3-iscsi devstack@n-api.service[103344]: Gracefully killing worker 1 (pid: 103344)... Aug 10 13:36:45.339111 dv-cinder-852009-3-iscsi devstack@n-api.service[103345]: Gracefully killing worker 2 (pid: 103345)... Aug 10 13:36:46.338671 dv-cinder-852009-3-iscsi devstack@n-api.service[103343]: worker 1 buried after 1 seconds Aug 10 13:36:46.339172 dv-cinder-852009-3-iscsi devstack@n-api.service[103343]: worker 2 buried after 1 seconds Aug 10 13:36:46.339172 dv-cinder-852009-3-iscsi devstack@n-api.service[103343]: goodbye to uWSGI. Aug 10 13:36:46.340215 dv-cinder-852009-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 10 13:36:46.340791 dv-cinder-852009-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 10 13:36:46.343628 dv-cinder-852009-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 10 13:36:46.354296 dv-cinder-852009-3-iscsi devstack@n-api.service[129507]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 10 13:36:46.356192 dv-cinder-852009-3-iscsi devstack@n-api.service[129507]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 10 13:36:46 2022] *** Aug 10 13:36:46.356192 dv-cinder-852009-3-iscsi devstack@n-api.service[129507]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 13:36:46.356192 dv-cinder-852009-3-iscsi devstack@n-api.service[129507]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 13:36:46.356192 dv-cinder-852009-3-iscsi devstack@n-api.service[129507]: nodename: dv-cinder-852009-3-iscsi Aug 10 13:36:46.356192 dv-cinder-852009-3-iscsi devstack@n-api.service[129507]: machine: x86_64 Aug 10 13:36:46.356192 dv-cinder-852009-3-iscsi devstack@n-api.service[129507]: clock source: unix Aug 10 13:36:46.356192 dv-cinder-852009-3-iscsi devstack@n-api.service[129507]: pcre jit disabled Aug 10 13:36:46.356192 dv-cinder-852009-3-iscsi devstack@n-api.service[129507]: detected number of CPU cores: 4 Aug 10 13:36:46.356192 dv-cinder-852009-3-iscsi devstack@n-api.service[129507]: current working directory: / Aug 10 13:36:46.356192 dv-cinder-852009-3-iscsi devstack@n-api.service[129507]: detected binary path: /usr/bin/uwsgi-core Aug 10 13:36:46.356192 dv-cinder-852009-3-iscsi devstack@n-api.service[129507]: your processes number limit is 47680 Aug 10 13:36:46.357059 dv-cinder-852009-3-iscsi devstack@n-api.service[129507]: your memory page size is 4096 bytes Aug 10 13:36:46.357059 dv-cinder-852009-3-iscsi devstack@n-api.service[129507]: detected max file descriptor number: 2048 Aug 10 13:36:46.357059 dv-cinder-852009-3-iscsi devstack@n-api.service[129507]: lock engine: pthread robust mutexes Aug 10 13:36:46.357059 dv-cinder-852009-3-iscsi devstack@n-api.service[129507]: thunder lock: enabled Aug 10 13:36:46.357059 dv-cinder-852009-3-iscsi devstack@n-api.service[129507]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 10 13:36:46.357059 dv-cinder-852009-3-iscsi devstack@n-api.service[129507]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 10 13:36:46.396455 dv-cinder-852009-3-iscsi devstack@n-api.service[129507]: Python main interpreter initialized at 0x55bc5d1539c0 Aug 10 13:36:46.396455 dv-cinder-852009-3-iscsi devstack@n-api.service[129507]: python threads support enabled Aug 10 13:36:46.396455 dv-cinder-852009-3-iscsi devstack@n-api.service[129507]: your server socket listen backlog is limited to 100 connections Aug 10 13:36:46.396455 dv-cinder-852009-3-iscsi devstack@n-api.service[129507]: your mercy for graceful operations on workers is 90 seconds Aug 10 13:36:46.396887 dv-cinder-852009-3-iscsi devstack@n-api.service[129507]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 13:36:46.396887 dv-cinder-852009-3-iscsi devstack@n-api.service[129507]: *** Operational MODE: preforking *** Aug 10 13:36:46.397183 dv-cinder-852009-3-iscsi devstack@n-api.service[129507]: *** uWSGI is running in multiple interpreter mode *** Aug 10 13:36:46.397183 dv-cinder-852009-3-iscsi devstack@n-api.service[129507]: spawned uWSGI master process (pid: 129507) Aug 10 13:36:46.397423 dv-cinder-852009-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 10 13:36:46.401284 dv-cinder-852009-3-iscsi devstack@n-api.service[129507]: spawned uWSGI worker 1 (pid: 129522, cores: 1) Aug 10 13:36:46.401284 dv-cinder-852009-3-iscsi devstack@n-api.service[129507]: spawned uWSGI worker 2 (pid: 129523, cores: 1) Aug 10 13:36:46.401284 dv-cinder-852009-3-iscsi devstack@n-api.service[129507]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 13:36:47.069082 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 13:36:47.071367 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 13:36:48.220177 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 13:36:48.220177 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: from cryptography.utils import int_from_bytes Aug 10 13:36:48.220899 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 13:36:48.220899 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: from cryptography.utils import int_from_bytes Aug 10 13:36:48.221541 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 13:36:48.221541 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: from cryptography.utils import int_from_bytes Aug 10 13:36:48.221992 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 13:36:48.221992 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: from cryptography.utils import int_from_bytes Aug 10 13:36:50.555312 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 13:36:50.556191 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 13:36:50.556717 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 13:36:50.557279 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 13:36:50.557422 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 13:36:50.557760 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.558087 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.558411 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.558730 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.559070 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.559372 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.559694 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.560018 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.560345 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.560606 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.560921 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.561263 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852009-3-iscsi {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.561591 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.561898 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.562209 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.562525 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.562831 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.563152 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.563468 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.563961 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.564481 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.564791 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.565247 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.565477 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.565792 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.566102 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.566423 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.566731 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.567050 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.567357 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.567765 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852009-3-iscsi {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.568073 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.568382 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.568694 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.569100 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.569435 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.569751 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.569887 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 13:36:50.570286 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.570376 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 13:36:50.570464 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.570665 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 13:36:50.570758 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.570986 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.571096 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 13:36:50.571279 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 13:36:50.571384 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.571604 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.571702 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.572436 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.572535 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.572738 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.572829 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.573045 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.573146 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.573379 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.573474 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.573696 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.573795 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.574000 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.574103 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.574303 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.574410 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.574552 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.574690 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.574842 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.574943 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.575160 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.575276 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.575478 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.575571 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852009-3-iscsi {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.575795 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.575902 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.576045 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.576150 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.576293 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.576467 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.576609 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.576789 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.576924 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.577097 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.577292 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.577449 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.577547 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.577752 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.577842 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.578144 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.578272 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.578450 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.578556 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.578759 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.578899 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.579062 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.579243 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.579354 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.579609 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.579717 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.579930 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.580029 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.580248 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.580379 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.580567 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.580666 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.580879 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.580983 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.581216 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.581412 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.581572 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.581671 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.581938 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852009-3-iscsi {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.582054 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.582258 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.582452 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.582604 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.582704 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.582877 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.582989 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.583195 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.583299 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.583514 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.583614 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.583815 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.583913 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.584187 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.584323 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.584540 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.584841 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.584982 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.585162 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.585335 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.585500 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.585629 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.585742 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.585867 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.586045 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.586171 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.586349 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.586470 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.586667 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.586799 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.586974 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.587098 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.587281 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.587438 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.588134 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.588285 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.588499 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.588627 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.588739 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.588860 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.589023 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.589158 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.589363 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.589483 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.589671 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.589791 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.589983 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.590110 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.590289 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.590417 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.590559 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.590689 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.590813 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.590932 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.591122 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.591247 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.591445 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.591574 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.591841 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.592069 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.592218 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.592426 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.592571 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.592725 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.592869 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.593009 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.593164 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.593356 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.593508 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.593650 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.593804 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.593952 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.594102 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.594251 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.594491 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.594640 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.594781 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.594923 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.595078 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.595219 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.595368 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.595508 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.595508 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.595806 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.595966 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.596124 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.596276 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.596424 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.596565 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.596720 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.596861 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.597001 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.597149 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.597394 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.597554 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.597721 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.597863 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.598016 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.598165 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.598320 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.598470 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.598730 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.598889 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.599032 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.599181 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.599322 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.599543 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.599667 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.599785 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.599895 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.600011 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.600130 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.600248 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.600364 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.600481 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.600600 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.600815 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.601091 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.601347 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.601505 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.601655 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.601816 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.601957 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.602108 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.602108 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.602387 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.602528 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.602674 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.602814 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.602994 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.603155 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.603298 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.603454 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.603613 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.603767 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.603923 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.604097 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.604243 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.604385 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.604385 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.604759 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.604914 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.605057 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.605311 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.605465 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.605606 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.605758 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.605914 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.606071 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.606257 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.606402 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.606549 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.606695 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.606848 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.606997 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.607147 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.607297 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.607447 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.607595 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.607756 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.607896 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.608044 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.608185 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.608366 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.608528 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.608681 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.608934 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.609092 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.609260 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.609409 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.609551 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.609712 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.609855 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.610008 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.610149 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.610290 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.610472 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.610627 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.610778 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.610930 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.611071 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.611211 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.611358 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.611507 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.611669 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.612064 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.612213 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.612361 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.612536 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.612691 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.612843 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.612985 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.612985 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.613275 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.613422 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.613574 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.613730 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.613882 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.614051 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.614208 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.614350 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.614490 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.614746 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.614906 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.615056 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.615206 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.615348 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.615488 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.615637 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.615791 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.615945 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:36:50.616097 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.616097 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.616373 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.616520 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.616673 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.616814 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.616963 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.617116 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.617319 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.617495 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.617648 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.617809 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.617953 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.618093 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.618241 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.618392 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.618541 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.618726 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.618873 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.619122 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.619286 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.619439 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.619582 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.619730 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.619894 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.620045 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.620187 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.620336 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.620478 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.620619 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.620768 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.620909 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.621064 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.621217 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.621391 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.621542 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.621684 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.621684 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.621985 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.622135 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.622277 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.622426 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.622574 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.622761 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.622918 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.623061 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.623203 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.623344 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.623484 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.623639 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.623789 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.623930 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.624077 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.624331 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.624487 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.624640 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.624872 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.625030 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.625173 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.625385 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.625528 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.625686 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.625839 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.625987 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.626138 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.626289 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.626431 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.626585 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.626734 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.626908 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.627053 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.627194 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.627334 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.627552 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.627703 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.627856 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.628006 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.628147 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.628296 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.628439 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.628587 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.628735 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.628875 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.629015 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.629173 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.629377 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.629605 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.629763 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.629903 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.630052 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.630202 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.630352 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.630493 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.630635 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.630782 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.630969 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.631129 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.631278 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.631426 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.631575 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.631726 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.631881 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.632030 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.632171 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.632326 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.632468 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.632608 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.632763 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.632913 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.633060 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.633200 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.633375 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.633518 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.633679 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.633821 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.633962 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.634110 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.634734 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.634902 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.635125 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.635280 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.635423 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.635563 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.635704 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.635855 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.636007 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.636166 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.636316 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.636464 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.636617 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.636771 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.636921 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.637069 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.637217 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.637393 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.637543 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.637694 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.637836 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.637977 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.638126 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.638267 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.638415 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.638570 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.638746 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.638903 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.639086 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.639255 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.639401 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.639555 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.639806 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.639963 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.640113 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.640265 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.640416 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.640557 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.640706 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.640855 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.640855 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.641135 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.641360 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.641517 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.641658 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.641798 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.641938 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.642099 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.642255 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.642396 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.642536 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.642675 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.642675 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.642958 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.643108 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.643257 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.643404 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.643545 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.643691 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.643840 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.643992 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.644139 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.644296 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.644436 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.644583 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.644736 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.644878 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.645025 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.645275 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.645427 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.645579 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.645730 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.645879 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.646033 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.646174 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.646316 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.646456 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.646604 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.646745 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.646886 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.647034 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.647215 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.647373 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.647515 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.647663 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.647803 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.647958 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.648098 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.648252 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.648402 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.648549 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.648690 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.648830 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.648969 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.649121 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.649281 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.649429 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.649569 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.649731 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.650509 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.650673 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.650816 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.650816 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.651213 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.651356 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.651508 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.651508 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.651784 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.651933 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.652073 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.652221 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.652385 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.652536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.652687 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.652836 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.652984 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.653125 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.653323 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.653471 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.653621 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.653621 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.653907 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.653907 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.654189 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.654189 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.654467 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.654467 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.654734 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.654881 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.655054 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.655054 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.655508 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.655650 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.655802 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.655963 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.656113 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.656263 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.656427 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.656569 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.656718 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.656939 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.657083 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.657249 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.657398 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.657549 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.657690 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.657841 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.657990 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.658131 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.658277 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.658429 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.658578 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.658731 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.658881 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.659033 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.659174 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.659322 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.659472 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.659622 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.659771 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.659920 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.660162 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.660321 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.660472 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.660615 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.660764 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.660905 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.661054 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.661195 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.661398 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.661541 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.661681 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.661822 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.661963 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.662110 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.662276 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.662425 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.662566 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.662706 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.662854 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.663004 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.663146 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.663286 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.663466 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.663612 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.663751 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.663910 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.664067 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.664228 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.664377 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.664377 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.664665 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.664823 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.664978 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.665127 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.665309 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.665577 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.665733 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.665901 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.666059 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.666218 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.666378 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.666533 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.666694 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.666851 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.667006 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.667153 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.667301 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.667455 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.667616 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.667765 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.667912 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.668060 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.668243 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.668407 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.668557 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.668705 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.668852 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.669013 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.669161 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.669335 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.669485 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.669633 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.669791 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.669953 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.670109 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.670371 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.670528 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.670686 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.670834 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.670995 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.671145 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.671293 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.671442 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.671597 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.671746 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.671913 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.672070 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.672308 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.672483 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.672633 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.672789 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.672938 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.673085 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.673259 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.673426 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.673578 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.673735 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.673891 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.674039 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.674039 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.674338 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.674338 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.674644 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.674801 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.674950 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.675096 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.675250 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.675408 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.675574 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.675802 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.675958 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.676116 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.676271 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.676445 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.676603 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.676760 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.676909 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.677065 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.677213 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.677494 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.677646 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.677802 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.677958 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.678114 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.678263 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.678263 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.678566 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.678722 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.678879 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.679028 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.679189 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.679345 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.679542 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.679696 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.679853 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.680001 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.680199 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.680374 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.680619 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.680785 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.680945 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.681636 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.681636 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.681951 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.682108 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.682266 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.682423 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.682581 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.682752 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.682902 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.683058 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.683227 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.683376 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.683531 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.683688 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.683843 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.684004 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.684166 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.684315 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.684463 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.684618 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.684775 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.684931 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.685090 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.685274 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.685443 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.685600 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.685748 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.685985 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.686156 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.686313 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.686471 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.686628 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.686785 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.686999 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.687152 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.687308 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.687468 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.687623 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.687771 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.687933 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.688082 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.688231 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.688378 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.688525 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.688679 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.688837 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.688985 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.689133 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.689348 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.689513 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.689662 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.689823 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.689984 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.690134 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.690290 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.690440 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.690620 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.690866 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.690866 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.691173 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.691173 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.691476 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.691639 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.691796 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.691999 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.692153 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.692308 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.692459 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.692620 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.692769 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.692925 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.693081 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.693246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.693413 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.693583 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.693734 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.693887 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.694035 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.694183 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.694399 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.694552 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.694707 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.694856 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.695003 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.695150 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.695311 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.695461 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.695657 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.695818 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.695985 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.696219 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.696389 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.696539 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.696689 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.697403 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.697559 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.697720 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.697879 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.698035 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.698191 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.698350 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.698499 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.698655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.698813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.698972 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.699121 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.699268 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.699416 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.699577 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.699727 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.699881 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.700040 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.700197 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.700355 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.700522 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.700680 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.700855 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.701104 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.701395 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.701567 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.701736 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.701888 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.702036 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.702199 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.702348 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.702504 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.702674 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.702823 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.702972 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.703121 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.703268 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.703425 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.703581 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.703730 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.703885 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.704043 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.704193 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.704353 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.704514 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.704662 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.704816 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.704974 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.705124 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.705344 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.705508 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.705664 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.705822 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.705977 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.706140 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.706380 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.706544 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.706717 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.706867 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.707014 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.707172 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.707321 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.707479 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.707628 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.707782 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.707938 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.708096 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.708246 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.708394 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.708549 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.708708 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.708864 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.709022 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.709173 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.709358 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.709509 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.709665 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.709665 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.709964 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.709964 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.710255 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.710411 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.710568 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.710734 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.710891 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.711053 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.711310 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.711465 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.711621 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.711818 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.711978 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.712134 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.712291 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.712484 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.712642 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.712642 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.712954 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.713104 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.713373 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.713373 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.713682 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.713833 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.713981 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.714127 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.714285 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.714443 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.714605 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.714755 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.714913 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.715061 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.715215 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.715364 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.715521 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.715678 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.715828 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.715975 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.716123 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.716277 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.716522 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.716688 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.716846 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.717015 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.717165 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.717165 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.717563 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.717563 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.717856 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.718004 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.718151 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.718151 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.718444 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.718602 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.718751 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.718899 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.719056 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.719213 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.719368 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.719525 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.719683 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.719833 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.719981 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.720141 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.720297 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.720446 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.720600 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.720757 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.720927 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.721076 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.721257 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.721513 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.721678 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.721844 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.722002 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.722151 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.722299 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.722455 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.722603 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.722760 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.722924 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.723085 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.723241 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.723390 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.723546 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.723695 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.723853 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.724011 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.724166 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.724316 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.724486 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.724798 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.724965 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.725115 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.725296 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.725462 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.725612 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.725774 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.725924 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.726075 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.726229 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.726390 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.726617 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.726781 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.726930 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.726930 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.727224 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.727372 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.727536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.727698 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.727902 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.728090 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.728248 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.728412 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.728570 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.728719 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.728875 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.729032 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.729182 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.729397 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.729556 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.729713 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.729869 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.730028 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.730180 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.730337 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.730494 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.730644 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.730791 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.730946 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.731106 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.731256 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.731416 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.731564 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.731737 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.731970 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.732134 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.732293 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.732450 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.732606 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.732756 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.732912 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.733070 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.733219 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.733395 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.733565 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.733724 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.733882 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.734040 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.734196 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.734355 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.734511 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.734668 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.734826 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.734975 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.735129 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.735285 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.735391 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.735473 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.735569 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.735655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.735744 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.735828 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.735917 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.736001 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.736134 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.736254 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.736369 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.736481 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.736646 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.737101 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.737251 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.737251 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.737472 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.737582 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.737703 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.737828 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.737940 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.738050 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.738160 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.738277 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.738395 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.738519 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.738630 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.738740 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.738850 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.738959 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.738959 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.738959 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.738959 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.739373 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.739490 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.739490 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.739708 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.739819 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.739930 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.739930 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.740156 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.740156 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.740385 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.740504 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.740622 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.740732 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.740842 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.740959 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.741082 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.741194 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.741371 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.741485 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.741595 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.741706 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.741825 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.741936 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.742156 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.742281 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.742399 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.742518 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.742629 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.742748 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.742859 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.742998 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.743111 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.743230 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.743348 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.743465 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.744088 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.744223 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.744344 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.744344 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.744636 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.744746 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.744858 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.744968 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.745077 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.745200 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.745358 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.745497 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.745615 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.745733 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.745857 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.745969 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.746087 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.746205 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.746331 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.746457 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.746576 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.746694 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.746842 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.747047 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.747171 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.747300 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.747442 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.747561 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.747678 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.747797 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.747906 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.748026 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.748137 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.748255 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.748365 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.748482 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.748593 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.748716 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.748827 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.748937 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.749047 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.749156 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.749313 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.749442 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.749554 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.749665 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.749774 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.749885 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.750003 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.750116 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.750225 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.750335 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.750499 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.750625 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.750808 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.750928 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.751161 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.751312 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.751432 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.751550 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.751725 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.751845 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.752034 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.752171 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.752379 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.752497 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.752643 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.752770 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.752954 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.753082 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.753476 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.753667 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.753819 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.753985 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.754142 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.754292 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.754456 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.754714 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.754893 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.755062 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.755312 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.755482 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.755482 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.755801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.755954 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.756109 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.756266 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.756416 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.756574 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.756731 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.756880 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.757061 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.757295 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.757455 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.757619 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.757768 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.757768 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.758070 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.758228 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.758384 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.758544 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.758544 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.758828 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.758976 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.759124 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.759337 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.760021 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.760021 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.760314 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.760314 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.760612 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.760775 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.760925 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.761074 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.761222 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.761426 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.761575 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.761575 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.761879 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.762036 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.762185 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.762367 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.762613 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.762783 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.762941 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.763090 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.763248 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.763437 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.763606 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.763765 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.763925 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.764082 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.764232 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.764380 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.764549 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.764698 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.764848 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.764995 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.765143 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.765326 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.765498 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.765648 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.765799 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.765956 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.766113 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.766276 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.766436 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.766586 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.766734 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.766892 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.767060 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.767225 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.767458 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.767622 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.767772 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.767922 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.768079 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.768079 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.768385 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.768534 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.768682 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.768831 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.768988 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.769150 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.769332 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.769485 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.769640 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.769796 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.769954 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.770105 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.770253 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.770412 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.770570 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.770720 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.770877 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.771028 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.771176 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.771330 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.771479 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.771627 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.771627 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.771921 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.772079 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.772246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.772402 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.772645 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.772890 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.773052 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.773211 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.773480 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.773645 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.773805 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.773954 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.774102 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.774252 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.774400 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.774559 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.774716 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.774891 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.775046 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.775194 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.775352 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.775509 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.775671 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.775828 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.775992 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.776150 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.776307 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.776469 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.776629 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.776629 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.776932 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.777092 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.777259 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.777450 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.777677 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.777677 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.777973 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.778130 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.778130 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.778427 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.778584 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.778756 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.778912 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.779062 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.779210 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.779368 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.779518 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.779667 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.779823 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.779980 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.780138 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.780295 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.780444 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.780613 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.780769 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.780919 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.781081 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.781310 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.781467 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.781618 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.781766 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.781915 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.782079 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.782237 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.782393 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.782550 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.782711 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.782888 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.783130 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.783294 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.783451 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.783650 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.783804 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.783963 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.784120 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.784269 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.784426 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.784575 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.784736 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.784899 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.785064 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.785223 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.785425 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.785583 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.785733 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.785895 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.786045 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.786192 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.786347 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.786506 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.786673 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.786846 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.787007 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.787156 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.787304 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.787455 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.787617 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.787852 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.788015 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.788164 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.788164 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.788462 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.788621 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.788781 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.788781 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.789067 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.789215 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.789405 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.789557 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.790299 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.790495 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.790662 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.790813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.790975 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.791145 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.791294 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.791452 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.791602 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.791764 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.791960 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.792166 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.792326 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.792476 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.792625 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.792781 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.792931 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.793081 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.793456 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.793671 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.793671 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.793671 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.794109 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.794269 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.794429 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.794585 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.794734 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.794892 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.795048 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.795198 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.795355 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.795523 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.795523 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.795821 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.795971 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.796133 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.796284 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.796440 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.796589 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.796739 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.796895 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.797064 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.797214 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.797399 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.797549 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.797697 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.797869 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.798111 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.798268 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.798425 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.798575 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.798731 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.798895 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.799054 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.799203 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.799353 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.799512 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.799661 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.799822 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.799822 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.800113 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.800261 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.800418 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.800574 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.800735 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.800885 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.801033 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.801181 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.801378 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.801671 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.801852 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.802012 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.802176 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.802326 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.802483 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.802711 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.802872 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.803031 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.803188 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.803336 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.803746 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.803849 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.803943 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.804027 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.804117 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.804208 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.804298 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.804395 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.804479 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.804560 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.804640 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.804723 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.804813 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.804894 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.804966 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.805043 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.805121 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.805193 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.805193 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.805193 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.805193 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.805193 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.805766 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.805868 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.806648 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.806751 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.806990 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.807095 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.807306 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.807412 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.807616 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.807714 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.807949 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.808143 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.808264 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.808449 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.808551 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.808796 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.808894 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.809122 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.809219 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.809493 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.809597 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.809817 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.809929 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.810159 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.810330 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.810474 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.810621 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.810768 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.810918 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.811068 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.811222 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.811392 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.811535 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.811715 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.811851 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.812024 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.812168 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.812354 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.812502 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.812678 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.812822 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.812978 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.813125 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.813334 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.813443 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.813616 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.813716 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.813933 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.814079 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.814243 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.814396 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.814555 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.814707 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.814864 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.815014 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.815173 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.815263 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 13:36:50.815488 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.815796 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.816106 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.816415 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.816725 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.817032 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.817363 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.817708 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.818021 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.818460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.818776 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.819087 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.819399 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.819740 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.820079 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.820409 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.820737 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.821055 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.821407 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.821780 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.822621 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.822951 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.823279 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.823596 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.823942 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.824250 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.824627 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.824969 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.825397 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.825718 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.826037 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.826393 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.826726 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.827041 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.827367 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.827694 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.828846 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.828846 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.828846 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.829154 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.829701 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.830016 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.830843 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.830843 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.831292 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.831376 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.831922 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.832296 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.832624 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.832953 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.833333 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.833669 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.834039 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.834326 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.834915 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.835056 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.835357 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.835797 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.836134 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.836459 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.836778 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.837091 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:36:50.837395 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 13:36:50.968325 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO dbcounter [None req-8c04494b-3ae5-4da6-8ef9-8eec9eac9eb6 None None] Registered counter for database nova_api Aug 10 13:36:50.987846 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO dbcounter [None req-3bb5a9be-de1a-4761-bbe7-b9687b464291 None None] Registered counter for database nova_api Aug 10 13:36:50.988455 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_db.sqlalchemy.engines [None req-8c04494b-3ae5-4da6-8ef9-8eec9eac9eb6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129522) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 13:36:50.995897 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writer thread running {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 13:36:51.007662 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_db.sqlalchemy.engines [None req-3bb5a9be-de1a-4761-bbe7-b9687b464291 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 13:36:51.014848 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writer thread running {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 13:36:51.055312 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.context [None req-8c04494b-3ae5-4da6-8ef9-8eec9eac9eb6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6d22d841-55fc-4fd5-b0b7-709b32bc1d30(cell1) {{(pid=129522) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 13:36:51.059548 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8c04494b-3ae5-4da6-8ef9-8eec9eac9eb6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:36:51.060008 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8c04494b-3ae5-4da6-8ef9-8eec9eac9eb6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:36:51.061984 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8c04494b-3ae5-4da6-8ef9-8eec9eac9eb6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:36:51.062349 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8c04494b-3ae5-4da6-8ef9-8eec9eac9eb6 None None] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:36:51.062805 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8c04494b-3ae5-4da6-8ef9-8eec9eac9eb6 None None] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:36:51.064825 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8c04494b-3ae5-4da6-8ef9-8eec9eac9eb6 None None] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:36:51.066927 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO dbcounter [None req-8c04494b-3ae5-4da6-8ef9-8eec9eac9eb6 None None] Registered counter for database nova_cell0 Aug 10 13:36:51.070724 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.context [None req-3bb5a9be-de1a-4761-bbe7-b9687b464291 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6d22d841-55fc-4fd5-b0b7-709b32bc1d30(cell1) {{(pid=129523) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 13:36:51.071070 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO dbcounter [None req-8c04494b-3ae5-4da6-8ef9-8eec9eac9eb6 None None] Registered counter for database nova_cell1 Aug 10 13:36:51.075324 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3bb5a9be-de1a-4761-bbe7-b9687b464291 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:36:51.075806 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3bb5a9be-de1a-4761-bbe7-b9687b464291 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:36:51.077403 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3bb5a9be-de1a-4761-bbe7-b9687b464291 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:36:51.078154 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3bb5a9be-de1a-4761-bbe7-b9687b464291 None None] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:36:51.078608 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3bb5a9be-de1a-4761-bbe7-b9687b464291 None None] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:36:51.079025 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_db.sqlalchemy.engines [None req-8c04494b-3ae5-4da6-8ef9-8eec9eac9eb6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129522) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 13:36:51.080715 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3bb5a9be-de1a-4761-bbe7-b9687b464291 None None] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:36:51.081683 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_db.sqlalchemy.engines [None req-8c04494b-3ae5-4da6-8ef9-8eec9eac9eb6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129522) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 13:36:51.082736 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO dbcounter [None req-3bb5a9be-de1a-4761-bbe7-b9687b464291 None None] Registered counter for database nova_cell0 Aug 10 13:36:51.086465 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writer thread running {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 13:36:51.086823 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO dbcounter [None req-3bb5a9be-de1a-4761-bbe7-b9687b464291 None None] Registered counter for database nova_cell1 Aug 10 13:36:51.089623 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writer thread running {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 13:36:51.094513 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_db.sqlalchemy.engines [None req-3bb5a9be-de1a-4761-bbe7-b9687b464291 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 13:36:51.095863 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_db.sqlalchemy.engines [None req-3bb5a9be-de1a-4761-bbe7-b9687b464291 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 13:36:51.102592 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writer thread running {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 13:36:51.104227 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writer thread running {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 13:36:51.236279 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO dbcounter [None req-8c04494b-3ae5-4da6-8ef9-8eec9eac9eb6 None None] Registered counter for database nova_cell0 Aug 10 13:36:51.245072 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_db.sqlalchemy.engines [None req-8c04494b-3ae5-4da6-8ef9-8eec9eac9eb6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129522) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 13:36:51.250700 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writer thread running {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 13:36:51.255831 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO dbcounter [None req-3bb5a9be-de1a-4761-bbe7-b9687b464291 None None] Registered counter for database nova_cell0 Aug 10 13:36:51.262981 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_db.sqlalchemy.engines [None req-3bb5a9be-de1a-4761-bbe7-b9687b464291 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 13:36:51.267506 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writer thread running {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 13:36:51.568433 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: WARNING keystonemiddleware.auth_token [None req-8c04494b-3ae5-4da6-8ef9-8eec9eac9eb6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 13:36:51.576285 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: WARNING keystonemiddleware.auth_token [None req-8c04494b-3ae5-4da6-8ef9-8eec9eac9eb6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 13:36:51.593976 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: WARNING keystonemiddleware.auth_token [None req-3bb5a9be-de1a-4761-bbe7-b9687b464291 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 13:36:51.601298 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: WARNING keystonemiddleware.auth_token [None req-3bb5a9be-de1a-4761-bbe7-b9687b464291 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 13:36:51.923648 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: WARNING keystonemiddleware.auth_token [None req-8c04494b-3ae5-4da6-8ef9-8eec9eac9eb6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 13:36:51.929653 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: WARNING keystonemiddleware.auth_token [None req-8c04494b-3ae5-4da6-8ef9-8eec9eac9eb6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 13:36:51.936395 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bc5d1539c0 pid: 129522 (default app) Aug 10 13:36:51.946510 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: WARNING keystonemiddleware.auth_token [None req-3bb5a9be-de1a-4761-bbe7-b9687b464291 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 13:36:51.952460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: WARNING keystonemiddleware.auth_token [None req-3bb5a9be-de1a-4761-bbe7-b9687b464291 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 13:36:51.958673 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bc5d1539c0 pid: 129523 (default app) Aug 10 13:37:27.853986 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_api:SELECT=3 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:37:27.856901 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell0:SELECT=3 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:37:27.861631 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell1:SELECT=3 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:37:27.863978 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell0:SELECT=3 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:37:28.970079 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-535fab52-05ff-402c-8eb3-c217924aff67 tempest-VolumesNegativeTest-1884044665 tempest-VolumesNegativeTest-1884044665-project] Action: 'create', calling method: .version_select at 0x7f49c6645dc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-553791234", "metadata": {"Type": "work"}}} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:37:28.982134 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-535fab52-05ff-402c-8eb3-c217924aff67 tempest-VolumesNegativeTest-1884044665 tempest-VolumesNegativeTest-1884044665-project] Request method failure captured: Aug 10 13:37:28.982134 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 13:37:28.982134 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept: application/json Aug 10 13:37:28.982134 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept-Encoding: identity Aug 10 13:37:28.982134 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Connection: close Aug 10 13:37:28.982134 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Length: 121 Aug 10 13:37:28.982134 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Type: application/json Aug 10 13:37:28.982134 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Host: 10.222.0.52 Aug 10 13:37:28.982134 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Openstack-System-Scope: None Aug 10 13:37:28.982134 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: User-Agent: python-urllib3/1.26.11 Aug 10 13:37:28.982134 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Auth-Token: gAAAAABi87SXgXIdU8J8Se3DoIZNYmj9-ght50_d0egtZ7J2Vw4zqCp4aoeKXB510sppf5jTGIguDaEF2pi8U6yfVDr1sdjKDS6PXf_5h6hT-_iHWlXc5At7sUQ1-Pz0y3YfNxDk89aW9T2h365j_R1yl3W2G7rJV-p0S3Sl4OiZvCXF2G3GSuc Aug 10 13:37:28.982134 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Id: None Aug 10 13:37:28.982134 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Name: None Aug 10 13:37:28.982134 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Identity-Status: Confirmed Aug 10 13:37:28.982134 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Is-Admin-Project: True Aug 10 13:37:28.982134 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Id: default Aug 10 13:37:28.982134 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Name: Default Aug 10 13:37:28.982134 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Id: 40ec5f56eca443eea502ea4afeadeaf8 Aug 10 13:37:28.982134 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Name: tempest-VolumesNegativeTest-1884044665 Aug 10 13:37:28.982134 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Role: member,reader Aug 10 13:37:28.982134 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Roles: member,reader Aug 10 13:37:28.983589 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/40ec5f56eca443eea502ea4afeadeaf8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40ec5f56eca443eea502ea4afeadeaf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_40ec5f56eca443eea502ea4afeadeaf8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40ec5f56eca443eea502ea4afeadeaf8"}]}] Aug 10 13:37:28.983589 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant: tempest-VolumesNegativeTest-1884044665 Aug 10 13:37:28.983589 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Id: 40ec5f56eca443eea502ea4afeadeaf8 Aug 10 13:37:28.983589 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Name: tempest-VolumesNegativeTest-1884044665 Aug 10 13:37:28.983589 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User: tempest-VolumesNegativeTest-1884044665-project Aug 10 13:37:28.983589 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Id: default Aug 10 13:37:28.983589 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Name: Default Aug 10 13:37:28.983589 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Id: c01b6746d6024e899578fb9180daf3d5 Aug 10 13:37:28.983589 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Name: tempest-VolumesNegativeTest-1884044665-project Aug 10 13:37:28.983589 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Aug 10 13:37:28.983589 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-553791234", "metadata": {"Type": "work"}}} Aug 10 13:37:28.983589 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: method: Aug 10 13:37:28.983589 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 13:37:28.984418 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-553791234', 'metadata': {'Type': 'work'}}}} Aug 10 13:37:28.984418 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:37:28.984418 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:37:28.984418 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 13:37:28.984418 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 13:37:28.984418 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 13:37:28.984418 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise error Aug 10 13:37:28.984418 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 10 13:37:28.984418 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:37:28.984418 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 10 13:37:28.984418 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 13:37:28.984418 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:37:28.984418 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 13:37:28.984418 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi '#$%' Aug 10 13:37:28.984418 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:37:28.984418 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:37:28.984418 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:37:28.984418 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:37:28.984418 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:37:28.984418 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:37:28.984418 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:37:28.984418 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:37:28.987525 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 13:37:28.987525 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 13:37:28.987525 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:37:28.987525 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:37:28.987525 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 13:37:28.987525 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 13:37:28.987525 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 13:37:28.987525 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 13:37:28.987525 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 13:37:28.987525 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 13:37:28.987525 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 13:37:28.987525 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:37:28.987525 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:37:28.987525 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:37:28.987525 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:37:28.987525 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:37:28.987525 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:37:28.987525 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 13:37:28.987525 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 13:37:28.991366 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 13:37:28.991366 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:37:28.995061 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-535fab52-05ff-402c-8eb3-c217924aff67 tempest-VolumesNegativeTest-1884044665 tempest-VolumesNegativeTest-1884044665-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:37:28.997262 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-535fab52-05ff-402c-8eb3-c217924aff67 tempest-VolumesNegativeTest-1884044665 tempest-VolumesNegativeTest-1884044665-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.169065 Aug 10 13:37:28.998776 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 1/1] 10.222.0.52 () {60 vars in 1156 bytes} [Wed Aug 10 13:37:27 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1172 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 13:37:29.434719 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-a5e3fb06-6dbc-42d6-a6bc-9406e4049461 tempest-VolumesNegativeTest-1884044665 tempest-VolumesNegativeTest-1884044665-project] Action: 'create', calling method: .version_select at 0x7f49c671d8b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1894949267", "metadata": {"Type": "work"}}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:37:29.442930 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-a5e3fb06-6dbc-42d6-a6bc-9406e4049461 tempest-VolumesNegativeTest-1884044665 tempest-VolumesNegativeTest-1884044665-project] Request method failure captured: Aug 10 13:37:29.442930 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 13:37:29.442930 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept: application/json Aug 10 13:37:29.442930 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept-Encoding: identity Aug 10 13:37:29.442930 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Connection: close Aug 10 13:37:29.442930 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Length: 120 Aug 10 13:37:29.442930 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Type: application/json Aug 10 13:37:29.442930 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Host: 10.222.0.52 Aug 10 13:37:29.442930 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Openstack-System-Scope: None Aug 10 13:37:29.442930 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: User-Agent: python-urllib3/1.26.11 Aug 10 13:37:29.442930 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Auth-Token: gAAAAABi87SXgXIdU8J8Se3DoIZNYmj9-ght50_d0egtZ7J2Vw4zqCp4aoeKXB510sppf5jTGIguDaEF2pi8U6yfVDr1sdjKDS6PXf_5h6hT-_iHWlXc5At7sUQ1-Pz0y3YfNxDk89aW9T2h365j_R1yl3W2G7rJV-p0S3Sl4OiZvCXF2G3GSuc Aug 10 13:37:29.442930 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Id: None Aug 10 13:37:29.442930 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Name: None Aug 10 13:37:29.442930 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Identity-Status: Confirmed Aug 10 13:37:29.442930 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Is-Admin-Project: True Aug 10 13:37:29.442930 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Id: default Aug 10 13:37:29.442930 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Name: Default Aug 10 13:37:29.442930 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Id: 40ec5f56eca443eea502ea4afeadeaf8 Aug 10 13:37:29.442930 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Name: tempest-VolumesNegativeTest-1884044665 Aug 10 13:37:29.442930 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Role: member,reader Aug 10 13:37:29.442930 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Roles: member,reader Aug 10 13:37:29.444505 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/40ec5f56eca443eea502ea4afeadeaf8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40ec5f56eca443eea502ea4afeadeaf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_40ec5f56eca443eea502ea4afeadeaf8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40ec5f56eca443eea502ea4afeadeaf8"}]}] Aug 10 13:37:29.444505 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant: tempest-VolumesNegativeTest-1884044665 Aug 10 13:37:29.444505 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Id: 40ec5f56eca443eea502ea4afeadeaf8 Aug 10 13:37:29.444505 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Name: tempest-VolumesNegativeTest-1884044665 Aug 10 13:37:29.444505 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User: tempest-VolumesNegativeTest-1884044665-project Aug 10 13:37:29.444505 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Id: default Aug 10 13:37:29.444505 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Name: Default Aug 10 13:37:29.444505 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Id: c01b6746d6024e899578fb9180daf3d5 Aug 10 13:37:29.444505 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Name: tempest-VolumesNegativeTest-1884044665-project Aug 10 13:37:29.444505 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Aug 10 13:37:29.444505 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1894949267", "metadata": {"Type": "work"}}} Aug 10 13:37:29.444505 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: method: Aug 10 13:37:29.444505 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 13:37:29.445403 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1894949267', 'metadata': {'Type': 'work'}}}} Aug 10 13:37:29.445403 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:37:29.445403 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:37:29.445403 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 13:37:29.445403 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 13:37:29.445403 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 13:37:29.445403 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise error Aug 10 13:37:29.445403 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 10 13:37:29.445403 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:37:29.445403 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 10 13:37:29.445403 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 13:37:29.445403 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:37:29.445403 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 13:37:29.445403 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi '0' Aug 10 13:37:29.445403 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:37:29.445403 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:37:29.445403 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:37:29.445403 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:37:29.445403 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:37:29.445403 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:37:29.445403 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:37:29.445403 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:37:29.446877 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 13:37:29.446877 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 13:37:29.446877 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:37:29.446877 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:37:29.446877 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 13:37:29.446877 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 13:37:29.446877 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 13:37:29.446877 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 13:37:29.446877 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 13:37:29.446877 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 13:37:29.446877 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 13:37:29.446877 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:37:29.446877 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:37:29.446877 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:37:29.446877 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:37:29.446877 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:37:29.446877 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:37:29.446877 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 13:37:29.446877 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 13:37:29.448050 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 13:37:29.448050 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:37:29.459007 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-a5e3fb06-6dbc-42d6-a6bc-9406e4049461 tempest-VolumesNegativeTest-1884044665 tempest-VolumesNegativeTest-1884044665-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:37:29.461202 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-a5e3fb06-6dbc-42d6-a6bc-9406e4049461 tempest-VolumesNegativeTest-1884044665 tempest-VolumesNegativeTest-1884044665-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.455418 Aug 10 13:37:29.463123 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 1/2] 10.222.0.52 () {60 vars in 1156 bytes} [Wed Aug 10 13:37:29 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 459 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 13:37:29.474214 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-003f63d8-4319-4668-bd5f-44fed0fc461d tempest-VolumesNegativeTest-1884044665 tempest-VolumesNegativeTest-1884044665-project] Action: 'create', calling method: .version_select at 0x7f49c65488b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-385353904", "metadata": {"Type": "work"}}} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:37:29.478393 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-003f63d8-4319-4668-bd5f-44fed0fc461d tempest-VolumesNegativeTest-1884044665 tempest-VolumesNegativeTest-1884044665-project] Request method failure captured: Aug 10 13:37:29.478393 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 13:37:29.478393 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept: application/json Aug 10 13:37:29.478393 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept-Encoding: identity Aug 10 13:37:29.478393 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Connection: close Aug 10 13:37:29.478393 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Length: 118 Aug 10 13:37:29.478393 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Type: application/json Aug 10 13:37:29.478393 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Host: 10.222.0.52 Aug 10 13:37:29.478393 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Openstack-System-Scope: None Aug 10 13:37:29.478393 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: User-Agent: python-urllib3/1.26.11 Aug 10 13:37:29.478393 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Auth-Token: gAAAAABi87SXgXIdU8J8Se3DoIZNYmj9-ght50_d0egtZ7J2Vw4zqCp4aoeKXB510sppf5jTGIguDaEF2pi8U6yfVDr1sdjKDS6PXf_5h6hT-_iHWlXc5At7sUQ1-Pz0y3YfNxDk89aW9T2h365j_R1yl3W2G7rJV-p0S3Sl4OiZvCXF2G3GSuc Aug 10 13:37:29.478393 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Id: None Aug 10 13:37:29.478393 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Name: None Aug 10 13:37:29.478393 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Identity-Status: Confirmed Aug 10 13:37:29.478393 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Is-Admin-Project: True Aug 10 13:37:29.478393 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Id: default Aug 10 13:37:29.478393 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Name: Default Aug 10 13:37:29.478393 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Id: 40ec5f56eca443eea502ea4afeadeaf8 Aug 10 13:37:29.478393 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Name: tempest-VolumesNegativeTest-1884044665 Aug 10 13:37:29.478393 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Role: member,reader Aug 10 13:37:29.478393 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Roles: member,reader Aug 10 13:37:29.479736 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/40ec5f56eca443eea502ea4afeadeaf8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40ec5f56eca443eea502ea4afeadeaf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_40ec5f56eca443eea502ea4afeadeaf8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40ec5f56eca443eea502ea4afeadeaf8"}]}] Aug 10 13:37:29.479736 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant: tempest-VolumesNegativeTest-1884044665 Aug 10 13:37:29.479736 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Id: 40ec5f56eca443eea502ea4afeadeaf8 Aug 10 13:37:29.479736 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Name: tempest-VolumesNegativeTest-1884044665 Aug 10 13:37:29.479736 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User: tempest-VolumesNegativeTest-1884044665-project Aug 10 13:37:29.479736 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Id: default Aug 10 13:37:29.479736 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Name: Default Aug 10 13:37:29.479736 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Id: c01b6746d6024e899578fb9180daf3d5 Aug 10 13:37:29.479736 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Name: tempest-VolumesNegativeTest-1884044665-project Aug 10 13:37:29.479736 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Aug 10 13:37:29.479736 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-385353904", "metadata": {"Type": "work"}}} Aug 10 13:37:29.479736 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: method: Aug 10 13:37:29.479736 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 13:37:29.480503 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-385353904', 'metadata': {'Type': 'work'}}}} Aug 10 13:37:29.480503 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:37:29.480503 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:37:29.480503 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 13:37:29.480503 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 13:37:29.480503 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 13:37:29.480503 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise error Aug 10 13:37:29.480503 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 10 13:37:29.480503 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:37:29.480503 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 10 13:37:29.480503 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 13:37:29.480503 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:37:29.480503 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 13:37:29.480503 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi '' Aug 10 13:37:29.480503 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:37:29.480503 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:37:29.480503 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:37:29.480503 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:37:29.480503 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:37:29.480503 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:37:29.480503 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:37:29.480503 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:37:29.481793 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 13:37:29.481793 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 13:37:29.481793 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:37:29.481793 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:37:29.481793 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 13:37:29.481793 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 13:37:29.481793 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 13:37:29.481793 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 13:37:29.481793 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 13:37:29.481793 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 13:37:29.481793 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 13:37:29.481793 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:37:29.481793 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:37:29.481793 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:37:29.481793 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:37:29.481793 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:37:29.481793 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:37:29.481793 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 13:37:29.481793 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 13:37:29.483736 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 13:37:29.483736 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:37:29.483736 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-003f63d8-4319-4668-bd5f-44fed0fc461d tempest-VolumesNegativeTest-1884044665 tempest-VolumesNegativeTest-1884044665-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:37:29.483736 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-003f63d8-4319-4668-bd5f-44fed0fc461d tempest-VolumesNegativeTest-1884044665 tempest-VolumesNegativeTest-1884044665-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010366 Aug 10 13:37:29.487827 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 2/3] 10.222.0.52 () {60 vars in 1156 bytes} [Wed Aug 10 13:37:29 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 13:37:29.491221 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_api:SELECT=3 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:37:29.493840 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell0:SELECT=3 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:37:29.495547 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell1:SELECT=3 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:37:29.499147 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell0:SELECT=3 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:37:29.512364 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-65c86175-aa8d-4c78-956f-b1eb96e94071 tempest-VolumesNegativeTest-1884044665 tempest-VolumesNegativeTest-1884044665-project] Calling method '.version_select at 0x7f49c66aa310>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:30.403599 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.wsgi [None req-65c86175-aa8d-4c78-956f-b1eb96e94071 tempest-VolumesNegativeTest-1884044665 tempest-VolumesNegativeTest-1884044665-project] HTTP exception thrown: Volume tempest-invalid-552079175 could not be found. Aug 10 13:37:30.407887 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-65c86175-aa8d-4c78-956f-b1eb96e94071 tempest-VolumesNegativeTest-1884044665 tempest-VolumesNegativeTest-1884044665-project] Request method failure captured: Aug 10 13:37:30.407887 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-552079175 HTTP/1.1 Aug 10 13:37:30.407887 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept: application/json Aug 10 13:37:30.407887 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept-Encoding: identity Aug 10 13:37:30.407887 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Connection: close Aug 10 13:37:30.407887 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Length: 0 Aug 10 13:37:30.407887 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Type: application/json Aug 10 13:37:30.407887 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Host: 10.222.0.52 Aug 10 13:37:30.407887 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Openstack-System-Scope: None Aug 10 13:37:30.407887 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: User-Agent: python-urllib3/1.26.11 Aug 10 13:37:30.407887 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Auth-Token: gAAAAABi87SXgXIdU8J8Se3DoIZNYmj9-ght50_d0egtZ7J2Vw4zqCp4aoeKXB510sppf5jTGIguDaEF2pi8U6yfVDr1sdjKDS6PXf_5h6hT-_iHWlXc5At7sUQ1-Pz0y3YfNxDk89aW9T2h365j_R1yl3W2G7rJV-p0S3Sl4OiZvCXF2G3GSuc Aug 10 13:37:30.407887 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Id: None Aug 10 13:37:30.407887 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Name: None Aug 10 13:37:30.407887 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Identity-Status: Confirmed Aug 10 13:37:30.407887 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Is-Admin-Project: True Aug 10 13:37:30.407887 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Id: default Aug 10 13:37:30.407887 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Name: Default Aug 10 13:37:30.407887 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Id: 40ec5f56eca443eea502ea4afeadeaf8 Aug 10 13:37:30.407887 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Name: tempest-VolumesNegativeTest-1884044665 Aug 10 13:37:30.407887 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Role: member,reader Aug 10 13:37:30.407887 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Roles: member,reader Aug 10 13:37:30.409452 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/40ec5f56eca443eea502ea4afeadeaf8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40ec5f56eca443eea502ea4afeadeaf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_40ec5f56eca443eea502ea4afeadeaf8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40ec5f56eca443eea502ea4afeadeaf8"}]}] Aug 10 13:37:30.409452 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant: tempest-VolumesNegativeTest-1884044665 Aug 10 13:37:30.409452 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Id: 40ec5f56eca443eea502ea4afeadeaf8 Aug 10 13:37:30.409452 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Name: tempest-VolumesNegativeTest-1884044665 Aug 10 13:37:30.409452 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User: tempest-VolumesNegativeTest-1884044665-project Aug 10 13:37:30.409452 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Id: default Aug 10 13:37:30.409452 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Name: Default Aug 10 13:37:30.409452 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Id: c01b6746d6024e899578fb9180daf3d5 Aug 10 13:37:30.409452 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Name: tempest-VolumesNegativeTest-1884044665-project Aug 10 13:37:30.409452 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: method: Aug 10 13:37:30.409452 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: exception: Volume tempest-invalid-552079175 could not be found. Aug 10 13:37:30.409452 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: action_args: {'id': 'tempest-invalid-552079175'} Aug 10 13:37:30.409452 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:37:30.410241 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:37:30.410241 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 13:37:30.410241 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 13:37:30.410241 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 13:37:30.410241 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 13:37:30.410241 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 13:37:30.410241 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 13:37:30.410241 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 13:37:30.410241 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 13:37:30.410241 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 13:37:30.410241 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 13:37:30.410241 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 13:37:30.410241 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 13:37:30.410241 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 13:37:30.410241 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 13:37:30.410241 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-552079175 could not be found. (HTTP 404) (Request-ID: req-fe429e60-e4e1-4705-b402-71f40aac1b73) Aug 10 13:37:30.410241 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:37:30.410241 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:37:30.410241 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:37:30.411416 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:37:30.411416 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 13:37:30.411416 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 13:37:30.411416 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 13:37:30.411416 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 13:37:30.411416 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 13:37:30.411416 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 13:37:30.411416 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 13:37:30.411416 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 13:37:30.411416 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 13:37:30.411416 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 13:37:30.411416 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 13:37:30.411416 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 13:37:30.411416 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 13:37:30.411416 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 13:37:30.411416 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 13:37:30.411416 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 13:37:30.411416 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 13:37:30.411416 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 13:37:30.413334 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 13:37:30.413334 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 13:37:30.413334 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 13:37:30.413334 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 13:37:30.413334 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-552079175 could not be found. Aug 10 13:37:30.413334 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:37:30.413334 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:37:30.413334 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:37:30.413334 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:37:30.413334 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:37:30.413334 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:37:30.413334 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:37:30.413334 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:37:30.413334 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 13:37:30.413334 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 13:37:30.413334 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:37:30.413334 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:37:30.413334 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 13:37:30.413334 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:37:30.413334 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-552079175 could not be found. Aug 10 13:37:30.416141 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:37:30.416141 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:37:30.416141 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:37:30.416141 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:37:30.416141 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:37:30.416141 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:37:30.416141 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:37:30.416141 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:37:30.416141 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-552079175 could not be found. Aug 10 13:37:30.416141 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:37:30.419909 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-65c86175-aa8d-4c78-956f-b1eb96e94071 tempest-VolumesNegativeTest-1884044665 tempest-VolumesNegativeTest-1884044665-project] Returning 404 to user: Volume tempest-invalid-552079175 could not be found. {{(pid=129523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:37:30.421143 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-65c86175-aa8d-4c78-956f-b1eb96e94071 tempest-VolumesNegativeTest-1884044665 tempest-VolumesNegativeTest-1884044665-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/tempest-invalid-552079175" status: 404 len: 98 microversion: 2.1 time: 0.933136 Aug 10 13:37:30.422362 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 2/4] 10.222.0.52 () {58 vars in 1215 bytes} [Wed Aug 10 13:37:29 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-552079175 => generated 98 bytes in 936 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 13:37:30.431108 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-3c6b9873-2a15-4d58-b0c4-e51b6952ef12 tempest-VolumesNegativeTest-1884044665 tempest-VolumesNegativeTest-1884044665-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003733 Aug 10 13:37:30.433431 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 3/5] 10.222.0.52 () {58 vars in 1140 bytes} [Wed Aug 10 13:37:30 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 10 13:37:30.442052 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-d0e08761-8a98-4644-913b-339f5e2949c4 tempest-VolumesNegativeTest-1884044665 tempest-VolumesNegativeTest-1884044665-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004998 Aug 10 13:37:30.444312 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 3/6] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Aug 10 13:37:30 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 10 13:37:30.464560 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-2d4970f4-7bfc-4dd2-8f1c-e75d554e04ce tempest-VolumesNegativeTest-1884044665 tempest-VolumesNegativeTest-1884044665-project] Calling method '.version_select at 0x7f49c6502b80>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:30.741981 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.wsgi [None req-2d4970f4-7bfc-4dd2-8f1c-e75d554e04ce tempest-VolumesNegativeTest-1884044665 tempest-VolumesNegativeTest-1884044665-project] HTTP exception thrown: Volume 88e9efa3-5868-49c7-8ab7-ce1e98662041 could not be found. Aug 10 13:37:30.746695 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-2d4970f4-7bfc-4dd2-8f1c-e75d554e04ce tempest-VolumesNegativeTest-1884044665 tempest-VolumesNegativeTest-1884044665-project] Request method failure captured: Aug 10 13:37:30.746695 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: request: DELETE /compute/v2.1/os-volumes/88e9efa3-5868-49c7-8ab7-ce1e98662041 HTTP/1.1 Aug 10 13:37:30.746695 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept: application/json Aug 10 13:37:30.746695 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept-Encoding: identity Aug 10 13:37:30.746695 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Connection: close Aug 10 13:37:30.746695 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Length: 0 Aug 10 13:37:30.746695 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Type: application/json Aug 10 13:37:30.746695 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Host: 10.222.0.52 Aug 10 13:37:30.746695 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Openstack-System-Scope: None Aug 10 13:37:30.746695 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: User-Agent: python-urllib3/1.26.11 Aug 10 13:37:30.746695 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Auth-Token: gAAAAABi87SXgXIdU8J8Se3DoIZNYmj9-ght50_d0egtZ7J2Vw4zqCp4aoeKXB510sppf5jTGIguDaEF2pi8U6yfVDr1sdjKDS6PXf_5h6hT-_iHWlXc5At7sUQ1-Pz0y3YfNxDk89aW9T2h365j_R1yl3W2G7rJV-p0S3Sl4OiZvCXF2G3GSuc Aug 10 13:37:30.746695 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Id: None Aug 10 13:37:30.746695 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Name: None Aug 10 13:37:30.746695 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Identity-Status: Confirmed Aug 10 13:37:30.746695 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Is-Admin-Project: True Aug 10 13:37:30.746695 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Id: default Aug 10 13:37:30.746695 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Name: Default Aug 10 13:37:30.746695 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Id: 40ec5f56eca443eea502ea4afeadeaf8 Aug 10 13:37:30.746695 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Name: tempest-VolumesNegativeTest-1884044665 Aug 10 13:37:30.746695 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Role: member,reader Aug 10 13:37:30.746695 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Roles: member,reader Aug 10 13:37:30.748058 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/40ec5f56eca443eea502ea4afeadeaf8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40ec5f56eca443eea502ea4afeadeaf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_40ec5f56eca443eea502ea4afeadeaf8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40ec5f56eca443eea502ea4afeadeaf8"}]}] Aug 10 13:37:30.748058 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant: tempest-VolumesNegativeTest-1884044665 Aug 10 13:37:30.748058 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Id: 40ec5f56eca443eea502ea4afeadeaf8 Aug 10 13:37:30.748058 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Name: tempest-VolumesNegativeTest-1884044665 Aug 10 13:37:30.748058 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User: tempest-VolumesNegativeTest-1884044665-project Aug 10 13:37:30.748058 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Id: default Aug 10 13:37:30.748058 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Name: Default Aug 10 13:37:30.748058 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Id: c01b6746d6024e899578fb9180daf3d5 Aug 10 13:37:30.748058 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Name: tempest-VolumesNegativeTest-1884044665-project Aug 10 13:37:30.748058 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: method: Aug 10 13:37:30.748058 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: exception: Volume 88e9efa3-5868-49c7-8ab7-ce1e98662041 could not be found. Aug 10 13:37:30.748058 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: action_args: {'id': '88e9efa3-5868-49c7-8ab7-ce1e98662041'} Aug 10 13:37:30.748058 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:37:30.748974 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:37:30.748974 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 13:37:30.748974 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 13:37:30.748974 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 13:37:30.748974 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 13:37:30.748974 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 13:37:30.748974 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 13:37:30.748974 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 13:37:30.748974 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 13:37:30.748974 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 13:37:30.748974 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 13:37:30.748974 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 13:37:30.748974 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 13:37:30.748974 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 13:37:30.748974 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 13:37:30.748974 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 88e9efa3-5868-49c7-8ab7-ce1e98662041 could not be found. (HTTP 404) (Request-ID: req-d4ca1043-0774-408a-8048-b57309c4d75c) Aug 10 13:37:30.748974 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:37:30.748974 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:37:30.748974 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:37:30.750150 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:37:30.750150 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 13:37:30.750150 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 13:37:30.750150 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 13:37:30.750150 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 13:37:30.750150 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 13:37:30.750150 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 13:37:30.750150 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 13:37:30.750150 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 13:37:30.750150 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 13:37:30.750150 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 13:37:30.750150 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 13:37:30.750150 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 13:37:30.750150 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 13:37:30.750150 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 13:37:30.750150 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 13:37:30.750150 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 13:37:30.750150 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 13:37:30.750150 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 13:37:30.751329 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 13:37:30.751329 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 13:37:30.751329 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 13:37:30.751329 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 13:37:30.751329 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 88e9efa3-5868-49c7-8ab7-ce1e98662041 could not be found. Aug 10 13:37:30.751329 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:37:30.751329 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:37:30.751329 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:37:30.751329 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:37:30.751329 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:37:30.751329 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:37:30.751329 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:37:30.751329 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:37:30.751329 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 13:37:30.751329 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 13:37:30.751329 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:37:30.751329 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:37:30.751329 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 13:37:30.751329 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:37:30.754823 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 88e9efa3-5868-49c7-8ab7-ce1e98662041 could not be found. Aug 10 13:37:30.754823 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:37:30.754823 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:37:30.754823 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:37:30.754823 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:37:30.754823 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:37:30.754823 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:37:30.754823 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:37:30.754823 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:37:30.754823 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 88e9efa3-5868-49c7-8ab7-ce1e98662041 could not be found. Aug 10 13:37:30.754823 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:37:30.759186 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-2d4970f4-7bfc-4dd2-8f1c-e75d554e04ce tempest-VolumesNegativeTest-1884044665 tempest-VolumesNegativeTest-1884044665-project] Returning 404 to user: Volume 88e9efa3-5868-49c7-8ab7-ce1e98662041 could not be found. {{(pid=129522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:37:30.760444 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-2d4970f4-7bfc-4dd2-8f1c-e75d554e04ce tempest-VolumesNegativeTest-1884044665 tempest-VolumesNegativeTest-1884044665-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/88e9efa3-5868-49c7-8ab7-ce1e98662041" status: 404 len: 109 microversion: 2.1 time: 0.301207 Aug 10 13:37:30.762292 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 4/7] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Aug 10 13:37:30 2022] DELETE /compute/v2.1/os-volumes/88e9efa3-5868-49c7-8ab7-ce1e98662041 => generated 109 bytes in 304 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 13:37:30.775740 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-6b91824f-4abb-4d0f-bb80-58ce2b1466bd tempest-VolumesNegativeTest-1884044665 tempest-VolumesNegativeTest-1884044665-project] Calling method '.version_select at 0x7f49c64519d0>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:30.816508 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.wsgi [None req-6b91824f-4abb-4d0f-bb80-58ce2b1466bd tempest-VolumesNegativeTest-1884044665 tempest-VolumesNegativeTest-1884044665-project] HTTP exception thrown: Volume c1d05446-7e35-47b8-8434-813a6b2c7d48 could not be found. Aug 10 13:37:30.818899 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-6b91824f-4abb-4d0f-bb80-58ce2b1466bd tempest-VolumesNegativeTest-1884044665 tempest-VolumesNegativeTest-1884044665-project] Request method failure captured: Aug 10 13:37:30.818899 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: request: GET /compute/v2.1/os-volumes/c1d05446-7e35-47b8-8434-813a6b2c7d48 HTTP/1.1 Aug 10 13:37:30.818899 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept: application/json Aug 10 13:37:30.818899 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept-Encoding: identity Aug 10 13:37:30.818899 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Connection: close Aug 10 13:37:30.818899 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Length: 0 Aug 10 13:37:30.818899 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Type: application/json Aug 10 13:37:30.818899 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Host: 10.222.0.52 Aug 10 13:37:30.818899 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Openstack-System-Scope: None Aug 10 13:37:30.818899 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: User-Agent: python-urllib3/1.26.11 Aug 10 13:37:30.818899 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Auth-Token: gAAAAABi87SXgXIdU8J8Se3DoIZNYmj9-ght50_d0egtZ7J2Vw4zqCp4aoeKXB510sppf5jTGIguDaEF2pi8U6yfVDr1sdjKDS6PXf_5h6hT-_iHWlXc5At7sUQ1-Pz0y3YfNxDk89aW9T2h365j_R1yl3W2G7rJV-p0S3Sl4OiZvCXF2G3GSuc Aug 10 13:37:30.818899 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Id: None Aug 10 13:37:30.818899 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Name: None Aug 10 13:37:30.818899 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Identity-Status: Confirmed Aug 10 13:37:30.818899 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Is-Admin-Project: True Aug 10 13:37:30.818899 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Id: default Aug 10 13:37:30.818899 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Name: Default Aug 10 13:37:30.818899 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Id: 40ec5f56eca443eea502ea4afeadeaf8 Aug 10 13:37:30.818899 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Name: tempest-VolumesNegativeTest-1884044665 Aug 10 13:37:30.818899 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Role: member,reader Aug 10 13:37:30.818899 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Roles: member,reader Aug 10 13:37:30.821851 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/40ec5f56eca443eea502ea4afeadeaf8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40ec5f56eca443eea502ea4afeadeaf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_40ec5f56eca443eea502ea4afeadeaf8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40ec5f56eca443eea502ea4afeadeaf8"}]}] Aug 10 13:37:30.821851 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant: tempest-VolumesNegativeTest-1884044665 Aug 10 13:37:30.821851 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Id: 40ec5f56eca443eea502ea4afeadeaf8 Aug 10 13:37:30.821851 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Name: tempest-VolumesNegativeTest-1884044665 Aug 10 13:37:30.821851 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User: tempest-VolumesNegativeTest-1884044665-project Aug 10 13:37:30.821851 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Id: default Aug 10 13:37:30.821851 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Name: Default Aug 10 13:37:30.821851 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Id: c01b6746d6024e899578fb9180daf3d5 Aug 10 13:37:30.821851 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Name: tempest-VolumesNegativeTest-1884044665-project Aug 10 13:37:30.821851 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: method: Aug 10 13:37:30.821851 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: exception: Volume c1d05446-7e35-47b8-8434-813a6b2c7d48 could not be found. Aug 10 13:37:30.821851 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: action_args: {'id': 'c1d05446-7e35-47b8-8434-813a6b2c7d48'} Aug 10 13:37:30.821851 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:37:30.822630 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:37:30.822630 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 13:37:30.822630 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 13:37:30.822630 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 13:37:30.822630 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 13:37:30.822630 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 13:37:30.822630 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 13:37:30.822630 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 13:37:30.822630 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 13:37:30.822630 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 13:37:30.822630 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 13:37:30.822630 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 13:37:30.822630 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 13:37:30.822630 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 13:37:30.822630 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 13:37:30.822630 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c1d05446-7e35-47b8-8434-813a6b2c7d48 could not be found. (HTTP 404) (Request-ID: req-47b43c65-f394-4ee3-9394-28021bb9f46d) Aug 10 13:37:30.822630 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:37:30.822630 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:37:30.822630 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:37:30.823792 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:37:30.823792 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 13:37:30.823792 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 13:37:30.823792 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 13:37:30.823792 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 13:37:30.823792 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 13:37:30.823792 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 13:37:30.823792 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 13:37:30.823792 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 13:37:30.823792 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 13:37:30.823792 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 13:37:30.823792 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 13:37:30.823792 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 13:37:30.823792 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 13:37:30.823792 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 13:37:30.823792 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 13:37:30.823792 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 13:37:30.823792 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 13:37:30.823792 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 13:37:30.824881 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 13:37:30.824881 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 13:37:30.824881 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 13:37:30.824881 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 13:37:30.824881 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c1d05446-7e35-47b8-8434-813a6b2c7d48 could not be found. Aug 10 13:37:30.824881 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:37:30.824881 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:37:30.824881 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:37:30.824881 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:37:30.824881 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:37:30.824881 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:37:30.824881 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:37:30.824881 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:37:30.824881 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 13:37:30.824881 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 13:37:30.824881 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:37:30.824881 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:37:30.824881 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 13:37:30.824881 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:37:30.826046 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c1d05446-7e35-47b8-8434-813a6b2c7d48 could not be found. Aug 10 13:37:30.826046 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:37:30.826046 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:37:30.826046 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:37:30.826046 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:37:30.826046 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:37:30.826046 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:37:30.826046 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:37:30.826046 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:37:30.826046 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c1d05446-7e35-47b8-8434-813a6b2c7d48 could not be found. Aug 10 13:37:30.826046 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:37:30.828448 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-6b91824f-4abb-4d0f-bb80-58ce2b1466bd tempest-VolumesNegativeTest-1884044665 tempest-VolumesNegativeTest-1884044665-project] Returning 404 to user: Volume c1d05446-7e35-47b8-8434-813a6b2c7d48 could not be found. {{(pid=129523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:37:30.830679 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-6b91824f-4abb-4d0f-bb80-58ce2b1466bd tempest-VolumesNegativeTest-1884044665 tempest-VolumesNegativeTest-1884044665-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/c1d05446-7e35-47b8-8434-813a6b2c7d48" status: 404 len: 109 microversion: 2.1 time: 0.060317 Aug 10 13:37:30.831871 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 4/8] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 10 13:37:30 2022] GET /compute/v2.1/os-volumes/c1d05446-7e35-47b8-8434-813a6b2c7d48 => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:37:39.646830 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-e1cbd02c-bec3-46bd-b514-30af1a768352 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Action: 'create', calling method: .version_select at 0x7f49c6450700>, body: {"keypair": {"name": "tempest-keypair-1251158532", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfadC/Di7a5gjHGGsTgzZv20bZBCGoPj+Rz3HHFsko9M2TStwch4v4UyMpZUNpfmm6RNekjjII9Z/Xc9cAUiFxqPhEPDf8DEobnY3vjFRB2F7eCPqojbNLOnZ0YhFKlMQ=="}} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:37:39.827258 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.quota [None req-e1cbd02c-bec3-46bd-b514-30af1a768352 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Getting quotas for project b6cfb6539b69493ebef06cf7176b1935. Resources: {'key_pairs'} {{(pid=129522) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:37:39.843328 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.quota [None req-e1cbd02c-bec3-46bd-b514-30af1a768352 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Getting quotas for user 9cecae4323404bd29fe8c05a704de273 and project b6cfb6539b69493ebef06cf7176b1935. Resources: {'key_pairs'} {{(pid=129522) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:37:39.968539 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-e1cbd02c-bec3-46bd-b514-30af1a768352 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.675020 Aug 10 13:37:39.987703 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 5/9] 10.222.0.52 () {62 vars in 1200 bytes} [Wed Aug 10 13:37:39 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 695 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 10 13:37:45.299127 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-35ca3977-1872-46c7-8cf5-9771faffe32a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Action: 'create', calling method: .version_select at 0x7f49c64513a0>, body: {"keypair": {"name": "tempest-keypair-1148496587", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0LscEL9TFcpi+QxJunDd/cgoNwKp37FSpEpLaDDXiNUcVVpvhrL/HGty0bFgxdiUGzcFPhIzkxUsmvGses1692kJTrn3Zsqv97znEe7JERA6TcFXDBP/RdgLM6h7HXNA=="}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:37:45.464433 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-35ca3977-1872-46c7-8cf5-9771faffe32a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Getting quotas for project 48e5556cbbfd4b00aa4f6055cd6238b2. Resources: {'key_pairs'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:37:45.517108 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-35ca3977-1872-46c7-8cf5-9771faffe32a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Getting quotas for user a3d9e5dc719c430eac6b5c8d8b814566 and project 48e5556cbbfd4b00aa4f6055cd6238b2. Resources: {'key_pairs'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:37:45.718693 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-35ca3977-1872-46c7-8cf5-9771faffe32a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.190439 Aug 10 13:37:45.721796 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 5/10] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Aug 10 13:37:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:37:49.697117 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-b0a3fd7e-e5de-4add-8308-d5483311144c tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-167724787", "imageRef": "096d81df-12b1-4175-b914-babe0fa931c6", "flavorRef": "452", "networks": [{"uuid": "88ffa1c6-6b2f-47c0-bc0a-549d12a5973d"}]}} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:37:49.869089 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.network.neutron [None req-b0a3fd7e-e5de-4add-8308-d5483311144c tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] validate_networks() for [('88ffa1c6-6b2f-47c0-bc0a-549d12a5973d', None, None, None, None, None)] {{(pid=129522) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:37:49.882459 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell0:SELECT=4 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:37:51.219097 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-d97c177b-123d-40ea-abb4-1ac367591158 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1488674335", "imageRef": "096d81df-12b1-4175-b914-babe0fa931c6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a2798d25-3b5d-43fb-8ba3-2bd216907bcd"}], "security_groups": [{"name": "tempest-securitygroup--1615437364"}], "key_name": "tempest-keypair-1148496587", "user_data": "}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:37:51.687284 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.network.neutron [None req-d97c177b-123d-40ea-abb4-1ac367591158 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] validate_networks() for [('a2798d25-3b5d-43fb-8ba3-2bd216907bcd', None, None, None, None, None)] {{(pid=129523) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:37:52.530573 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.virt.hardware [None req-b0a3fd7e-e5de-4add-8308-d5483311144c tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Flavor limits 0:0:0 {{(pid=129522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:37:52.531216 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.virt.hardware [None req-b0a3fd7e-e5de-4add-8308-d5483311144c tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Image limits 0:0:0 {{(pid=129522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:37:52.531799 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.virt.hardware [None req-b0a3fd7e-e5de-4add-8308-d5483311144c tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Flavor pref 0:0:0 {{(pid=129522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:37:52.534840 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.virt.hardware [None req-b0a3fd7e-e5de-4add-8308-d5483311144c tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Image pref 0:0:0 {{(pid=129522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:37:52.535394 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.virt.hardware [None req-b0a3fd7e-e5de-4add-8308-d5483311144c tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:37:52.561269 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b0a3fd7e-e5de-4add-8308-d5483311144c tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:52.564829 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b0a3fd7e-e5de-4add-8308-d5483311144c tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:52.566669 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b0a3fd7e-e5de-4add-8308-d5483311144c tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:52.568821 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b0a3fd7e-e5de-4add-8308-d5483311144c tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:52.574500 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b0a3fd7e-e5de-4add-8308-d5483311144c tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:52.575097 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b0a3fd7e-e5de-4add-8308-d5483311144c tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:52.718960 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.quota [None req-b0a3fd7e-e5de-4add-8308-d5483311144c tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Getting quotas for project 18c99d576d184b04b933db13eabb8c5e. Resources: {'cores', 'ram', 'instances'} {{(pid=129522) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:37:52.739751 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.quota [None req-b0a3fd7e-e5de-4add-8308-d5483311144c tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Getting quotas for user 258ccb4bb15a4747b4c17d2a26645888 and project 18c99d576d184b04b933db13eabb8c5e. Resources: {'cores', 'ram', 'instances'} {{(pid=129522) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:37:52.784676 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-b0a3fd7e-e5de-4add-8308-d5483311144c tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Going to run 1 instances... {{(pid=129522) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:37:52.796833 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-b0a3fd7e-e5de-4add-8308-d5483311144c tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] [instance: a3e6b964-a4d5-4c24-8c8c-19373ddd2fff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='096d81df-12b1-4175-b914-babe0fa931c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129522) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:37:53.072092 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-b0a3fd7e-e5de-4add-8308-d5483311144c tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.887137 Aug 10 13:37:53.080660 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 6/11] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 10 13:37:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 3896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 13:37:53.109488 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-499e8294-69be-4741-830d-6b03e9aed536 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1322638041", "imageRef": "096d81df-12b1-4175-b914-babe0fa931c6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b0f41cec-19b4-4ff0-8893-5680cf3ee461"}], "security_groups": [{"name": "tempest-securitygroup--1813238663"}], "key_name": "tempest-keypair-1251158532", "user_data": "}} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:37:53.600285 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-d97c177b-123d-40ea-abb4-1ac367591158 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Flavor limits 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:37:53.600871 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-d97c177b-123d-40ea-abb4-1ac367591158 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Image limits 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:37:53.601580 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-d97c177b-123d-40ea-abb4-1ac367591158 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Flavor pref 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:37:53.602656 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-d97c177b-123d-40ea-abb4-1ac367591158 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Image pref 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:37:53.603067 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-d97c177b-123d-40ea-abb4-1ac367591158 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:37:53.634584 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d97c177b-123d-40ea-abb4-1ac367591158 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:53.635806 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d97c177b-123d-40ea-abb4-1ac367591158 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:53.639766 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d97c177b-123d-40ea-abb4-1ac367591158 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:53.643208 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d97c177b-123d-40ea-abb4-1ac367591158 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:53.645385 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d97c177b-123d-40ea-abb4-1ac367591158 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:53.646139 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d97c177b-123d-40ea-abb4-1ac367591158 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:53.720496 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-d97c177b-123d-40ea-abb4-1ac367591158 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Getting quotas for project 48e5556cbbfd4b00aa4f6055cd6238b2. Resources: {'cores', 'ram', 'instances'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:37:53.736087 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-d97c177b-123d-40ea-abb4-1ac367591158 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Getting quotas for user a3d9e5dc719c430eac6b5c8d8b814566 and project 48e5556cbbfd4b00aa4f6055cd6238b2. Resources: {'cores', 'ram', 'instances'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:37:53.775608 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-d97c177b-123d-40ea-abb4-1ac367591158 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Going to run 1 instances... {{(pid=129523) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:37:53.784793 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-d97c177b-123d-40ea-abb4-1ac367591158 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 41baab24-f648-4e7d-83bb-4357214ea438] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='096d81df-12b1-4175-b914-babe0fa931c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:37:53.891317 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.network.neutron [None req-499e8294-69be-4741-830d-6b03e9aed536 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] validate_networks() for [('b0f41cec-19b4-4ff0-8893-5680cf3ee461', None, None, None, None, None)] {{(pid=129522) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:37:54.055022 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-d97c177b-123d-40ea-abb4-1ac367591158 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.844244 Aug 10 13:37:54.056102 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 6/12] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 10 13:37:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 2846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 13:37:54.068298 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-4db5395d-c960-459e-95f6-6240f6870e9b tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:54.068953 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-4db5395d-c960-459e-95f6-6240f6870e9b tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] [instance: a3e6b964-a4d5-4c24-8c8c-19373ddd2fff] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:54.428790 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-4db5395d-c960-459e-95f6-6240f6870e9b tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258ccb4bb15a4747b4c17d2a26645888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c99d576d184b04b933db13eabb8c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:54.465370 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-4db5395d-c960-459e-95f6-6240f6870e9b tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] 10.222.0.52 "GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff" status: 200 len: 1214 microversion: 2.1 time: 0.407971 Aug 10 13:37:54.465951 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 7/13] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:54 2022] GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff => generated 1214 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:37:54.500697 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-720df812-7b8e-420c-a413-f7b3142f9d1b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:54.501294 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-720df812-7b8e-420c-a413-f7b3142f9d1b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 41baab24-f648-4e7d-83bb-4357214ea438] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:54.636875 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-720df812-7b8e-420c-a413-f7b3142f9d1b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:54.649328 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-720df812-7b8e-420c-a413-f7b3142f9d1b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438" status: 200 len: 1242 microversion: 2.1 time: 0.163321 Aug 10 13:37:54.652220 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 8/14] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:54 2022] GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438 => generated 1242 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:37:55.558686 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-b45a7793-63f6-4ea0-ac77-93f3d8d87893 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-41993577", "imageRef": "096d81df-12b1-4175-b914-babe0fa931c6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:37:55.728944 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.network.neutron [None req-b45a7793-63f6-4ea0-ac77-93f3d8d87893 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] validate_networks() for [('c07bfdaa-43c4-49b6-bcd2-4f11035d1c09', None, None, None, None, None)] {{(pid=129523) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:37:56.034212 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.virt.hardware [None req-499e8294-69be-4741-830d-6b03e9aed536 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Flavor limits 0:0:0 {{(pid=129522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:37:56.034724 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.virt.hardware [None req-499e8294-69be-4741-830d-6b03e9aed536 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Image limits 0:0:0 {{(pid=129522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:37:56.035264 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.virt.hardware [None req-499e8294-69be-4741-830d-6b03e9aed536 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Flavor pref 0:0:0 {{(pid=129522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:37:56.035866 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.virt.hardware [None req-499e8294-69be-4741-830d-6b03e9aed536 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Image pref 0:0:0 {{(pid=129522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:37:56.036570 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.virt.hardware [None req-499e8294-69be-4741-830d-6b03e9aed536 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:37:56.057805 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-499e8294-69be-4741-830d-6b03e9aed536 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:56.058973 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-499e8294-69be-4741-830d-6b03e9aed536 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:56.059778 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-499e8294-69be-4741-830d-6b03e9aed536 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:56.061155 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-499e8294-69be-4741-830d-6b03e9aed536 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:56.062838 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-499e8294-69be-4741-830d-6b03e9aed536 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:56.064338 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-499e8294-69be-4741-830d-6b03e9aed536 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:56.146887 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.quota [None req-499e8294-69be-4741-830d-6b03e9aed536 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Getting quotas for project b6cfb6539b69493ebef06cf7176b1935. Resources: {'cores', 'ram', 'instances'} {{(pid=129522) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:37:56.170602 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.quota [None req-499e8294-69be-4741-830d-6b03e9aed536 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Getting quotas for user 9cecae4323404bd29fe8c05a704de273 and project b6cfb6539b69493ebef06cf7176b1935. Resources: {'cores', 'ram', 'instances'} {{(pid=129522) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:37:56.228512 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-499e8294-69be-4741-830d-6b03e9aed536 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Going to run 1 instances... {{(pid=129522) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:37:56.235949 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-499e8294-69be-4741-830d-6b03e9aed536 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='096d81df-12b1-4175-b914-babe0fa931c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129522) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:37:56.360804 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-499e8294-69be-4741-830d-6b03e9aed536 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.274277 Aug 10 13:37:56.368127 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 7/15] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Aug 10 13:37:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 3287 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 13:37:56.693639 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-548966a9-d9a0-4155-9688-e4491a0f7a4e tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Action: 'create', calling method: .version_select at 0x7f49c5b169d0>, body: {"keypair": {"name": "tempest-keypair-386222063", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOyIGn62So+nLb2XBzeyBFpAwKHyUF4FOzG4NpHVcbsiGgVwfMbKOWuSOR9MC420vSof6/aijGbc7Z2+zb6MkpiQK9+bX72GuKbUYrNhtLYQZ/St0Y1j7WrJgjH1u+Qkg=="}} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:37:56.744871 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.quota [None req-548966a9-d9a0-4155-9688-e4491a0f7a4e tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Getting quotas for project 6f889848d459459484b5b5517fef576b. Resources: {'key_pairs'} {{(pid=129522) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:37:56.750562 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.quota [None req-548966a9-d9a0-4155-9688-e4491a0f7a4e tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Getting quotas for user 289c7d8b89cd445a924f5ac07e85fe48 and project 6f889848d459459484b5b5517fef576b. Resources: {'key_pairs'} {{(pid=129522) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:37:56.782123 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-548966a9-d9a0-4155-9688-e4491a0f7a4e tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.412556 Aug 10 13:37:56.784044 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 8/16] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Aug 10 13:37:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:37:56.792025 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-2ed9e874-1b03-42ad-a3e3-017846152ea5 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:56.792983 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-2ed9e874-1b03-42ad-a3e3-017846152ea5 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] [instance: a3e6b964-a4d5-4c24-8c8c-19373ddd2fff] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:56.814126 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2ed9e874-1b03-42ad-a3e3-017846152ea5 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:56.815271 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2ed9e874-1b03-42ad-a3e3-017846152ea5 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:56.816121 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2ed9e874-1b03-42ad-a3e3-017846152ea5 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:56.817120 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2ed9e874-1b03-42ad-a3e3-017846152ea5 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:56.818350 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2ed9e874-1b03-42ad-a3e3-017846152ea5 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:56.819310 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2ed9e874-1b03-42ad-a3e3-017846152ea5 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:57.246745 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-2ed9e874-1b03-42ad-a3e3-017846152ea5 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258ccb4bb15a4747b4c17d2a26645888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c99d576d184b04b933db13eabb8c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:57.283458 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-2ed9e874-1b03-42ad-a3e3-017846152ea5 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] 10.222.0.52 "GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff" status: 200 len: 1266 microversion: 2.1 time: 0.495992 Aug 10 13:37:57.285648 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 9/17] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:56 2022] GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff => generated 1266 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:37:57.294637 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-9c5edab3-6025-42e9-8e3f-ef184904af0d tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:57.308900 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-9c5edab3-6025-42e9-8e3f-ef184904af0d tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 41baab24-f648-4e7d-83bb-4357214ea438] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:57.354024 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9c5edab3-6025-42e9-8e3f-ef184904af0d tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:57.354534 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9c5edab3-6025-42e9-8e3f-ef184904af0d tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:57.354975 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9c5edab3-6025-42e9-8e3f-ef184904af0d tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:57.367442 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9c5edab3-6025-42e9-8e3f-ef184904af0d tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:57.372360 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9c5edab3-6025-42e9-8e3f-ef184904af0d tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:57.372881 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9c5edab3-6025-42e9-8e3f-ef184904af0d tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:57.566880 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-b45a7793-63f6-4ea0-ac77-93f3d8d87893 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Flavor limits 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:37:57.567385 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-b45a7793-63f6-4ea0-ac77-93f3d8d87893 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Image limits 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:37:57.568533 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-b45a7793-63f6-4ea0-ac77-93f3d8d87893 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Flavor pref 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:37:57.569062 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-b45a7793-63f6-4ea0-ac77-93f3d8d87893 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Image pref 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:37:57.571540 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-b45a7793-63f6-4ea0-ac77-93f3d8d87893 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:37:57.594649 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b45a7793-63f6-4ea0-ac77-93f3d8d87893 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:57.598602 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b45a7793-63f6-4ea0-ac77-93f3d8d87893 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:57.599663 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b45a7793-63f6-4ea0-ac77-93f3d8d87893 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:57.602577 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b45a7793-63f6-4ea0-ac77-93f3d8d87893 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:57.604847 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b45a7793-63f6-4ea0-ac77-93f3d8d87893 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:57.606764 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b45a7793-63f6-4ea0-ac77-93f3d8d87893 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:57.715613 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-b45a7793-63f6-4ea0-ac77-93f3d8d87893 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Getting quotas for project d8eda7c7d6a348e08e81a6b2496b09e5. Resources: {'cores', 'ram', 'instances'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:37:57.742110 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-b45a7793-63f6-4ea0-ac77-93f3d8d87893 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Getting quotas for user 5573338f0bd64c729c7d89345069ca6f and project d8eda7c7d6a348e08e81a6b2496b09e5. Resources: {'cores', 'ram', 'instances'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:37:57.772150 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-b45a7793-63f6-4ea0-ac77-93f3d8d87893 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Going to run 1 instances... {{(pid=129523) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:37:57.776035 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-b45a7793-63f6-4ea0-ac77-93f3d8d87893 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 9107fc16-6a2c-48ad-8612-964c3ac05c01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='096d81df-12b1-4175-b914-babe0fa931c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:37:57.991514 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-b45a7793-63f6-4ea0-ac77-93f3d8d87893 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.312940 Aug 10 13:37:57.992913 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 9/18] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 10 13:37:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 3339 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 13:37:57.998129 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-3afe8a6c-7ba3-48d9-bb0f-359a035243a2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:57.998959 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-3afe8a6c-7ba3-48d9-bb0f-359a035243a2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:58.011216 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3afe8a6c-7ba3-48d9-bb0f-359a035243a2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:58.012711 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3afe8a6c-7ba3-48d9-bb0f-359a035243a2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:58.014033 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3afe8a6c-7ba3-48d9-bb0f-359a035243a2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:58.015043 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3afe8a6c-7ba3-48d9-bb0f-359a035243a2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:58.015658 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3afe8a6c-7ba3-48d9-bb0f-359a035243a2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:58.025692 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3afe8a6c-7ba3-48d9-bb0f-359a035243a2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:58.169517 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-9c5edab3-6025-42e9-8e3f-ef184904af0d tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:58.183105 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-9c5edab3-6025-42e9-8e3f-ef184904af0d tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438" status: 200 len: 1294 microversion: 2.1 time: 0.892043 Aug 10 13:37:58.197333 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 10/19] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:57 2022] GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438 => generated 1294 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:37:58.238842 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-c02a521a-ce05-4141-b83e-aed0b06f9555 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:58.239704 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-c02a521a-ce05-4141-b83e-aed0b06f9555 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 9107fc16-6a2c-48ad-8612-964c3ac05c01] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:58.574390 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-3afe8a6c-7ba3-48d9-bb0f-359a035243a2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:58.633857 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-3afe8a6c-7ba3-48d9-bb0f-359a035243a2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:58.637000 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-3afe8a6c-7ba3-48d9-bb0f-359a035243a2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:58.640962 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-3afe8a6c-7ba3-48d9-bb0f-359a035243a2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1334 microversion: 2.20 time: 0.646725 Aug 10 13:37:58.648018 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 10/20] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:37:57 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1334 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:37:58.661336 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-c4916a21-3412-457f-9112-6c63a1453e47 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:58.666559 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-c4916a21-3412-457f-9112-6c63a1453e47 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] [instance: a3e6b964-a4d5-4c24-8c8c-19373ddd2fff] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:58.693090 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c4916a21-3412-457f-9112-6c63a1453e47 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:58.695994 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c4916a21-3412-457f-9112-6c63a1453e47 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:58.700510 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c4916a21-3412-457f-9112-6c63a1453e47 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:58.702589 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c4916a21-3412-457f-9112-6c63a1453e47 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:58.708092 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c4916a21-3412-457f-9112-6c63a1453e47 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:58.708834 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c4916a21-3412-457f-9112-6c63a1453e47 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:58.747994 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-c02a521a-ce05-4141-b83e-aed0b06f9555 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:58.772578 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-c02a521a-ce05-4141-b83e-aed0b06f9555 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01" status: 200 len: 1220 microversion: 2.1 time: 0.572677 Aug 10 13:37:58.774525 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 11/21] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:58 2022] GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01 => generated 1220 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:37:59.108651 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-c4916a21-3412-457f-9112-6c63a1453e47 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258ccb4bb15a4747b4c17d2a26645888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c99d576d184b04b933db13eabb8c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:37:59.124346 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-c4916a21-3412-457f-9112-6c63a1453e47 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] 10.222.0.52 "GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff" status: 200 len: 1272 microversion: 2.1 time: 0.473903 Aug 10 13:37:59.127891 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 11/22] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:58 2022] GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff => generated 1272 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:37:59.202865 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-97eda3cb-7c8f-4277-b8da-7c26789c563f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:37:59.203694 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-97eda3cb-7c8f-4277-b8da-7c26789c563f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 41baab24-f648-4e7d-83bb-4357214ea438] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:37:59.217690 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-97eda3cb-7c8f-4277-b8da-7c26789c563f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:59.221875 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-97eda3cb-7c8f-4277-b8da-7c26789c563f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:59.224192 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-97eda3cb-7c8f-4277-b8da-7c26789c563f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:59.228034 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-97eda3cb-7c8f-4277-b8da-7c26789c563f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:37:59.230420 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-97eda3cb-7c8f-4277-b8da-7c26789c563f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:37:59.232102 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-97eda3cb-7c8f-4277-b8da-7c26789c563f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:37:59.401885 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-12becf59-3616-4271-9a70-4557ef58e174 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2069535051", "imageRef": "096d81df-12b1-4175-b914-babe0fa931c6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:37:59.564078 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.network.neutron [None req-12becf59-3616-4271-9a70-4557ef58e174 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] validate_networks() for [('c07bfdaa-43c4-49b6-bcd2-4f11035d1c09', None, None, None, None, None)] {{(pid=129523) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:38:00.082511 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-97eda3cb-7c8f-4277-b8da-7c26789c563f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:00.097334 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-97eda3cb-7c8f-4277-b8da-7c26789c563f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438" status: 200 len: 1300 microversion: 2.1 time: 0.898260 Aug 10 13:38:00.098381 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 12/23] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:37:59 2022] GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438 => generated 1300 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:00.116020 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-d9298274-f119-46cb-a227-8135a35cd3fc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:00.116653 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-d9298274-f119-46cb-a227-8135a35cd3fc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:00.156516 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d9298274-f119-46cb-a227-8135a35cd3fc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:00.156955 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d9298274-f119-46cb-a227-8135a35cd3fc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:00.157430 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d9298274-f119-46cb-a227-8135a35cd3fc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:00.158153 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d9298274-f119-46cb-a227-8135a35cd3fc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:00.158614 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d9298274-f119-46cb-a227-8135a35cd3fc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:00.159033 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d9298274-f119-46cb-a227-8135a35cd3fc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:00.715680 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-d9298274-f119-46cb-a227-8135a35cd3fc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:00.729139 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-d9298274-f119-46cb-a227-8135a35cd3fc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:00.734180 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-d9298274-f119-46cb-a227-8135a35cd3fc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:00.739565 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-d9298274-f119-46cb-a227-8135a35cd3fc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1340 microversion: 2.20 time: 0.635657 Aug 10 13:38:00.751594 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 13/24] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:38:00 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1340 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:38:00.759021 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-f2986b49-1a97-4737-a524-6d0f0ec423c8 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:00.759967 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-f2986b49-1a97-4737-a524-6d0f0ec423c8 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] [instance: a3e6b964-a4d5-4c24-8c8c-19373ddd2fff] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:00.766842 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f2986b49-1a97-4737-a524-6d0f0ec423c8 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:00.767764 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f2986b49-1a97-4737-a524-6d0f0ec423c8 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:00.768589 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f2986b49-1a97-4737-a524-6d0f0ec423c8 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:00.769574 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f2986b49-1a97-4737-a524-6d0f0ec423c8 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:00.770247 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f2986b49-1a97-4737-a524-6d0f0ec423c8 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:00.770881 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f2986b49-1a97-4737-a524-6d0f0ec423c8 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:00.912476 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-f2986b49-1a97-4737-a524-6d0f0ec423c8 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258ccb4bb15a4747b4c17d2a26645888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c99d576d184b04b933db13eabb8c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:00.931342 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-f2986b49-1a97-4737-a524-6d0f0ec423c8 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] 10.222.0.52 "GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff" status: 200 len: 1272 microversion: 2.1 time: 0.172585 Aug 10 13:38:00.945706 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 14/25] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:00 2022] GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff => generated 1272 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:01.124808 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-3fc1d36b-3887-4f64-9d78-08f9a569bef5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:01.126622 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-3fc1d36b-3887-4f64-9d78-08f9a569bef5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 41baab24-f648-4e7d-83bb-4357214ea438] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:01.147861 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3fc1d36b-3887-4f64-9d78-08f9a569bef5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:01.152364 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3fc1d36b-3887-4f64-9d78-08f9a569bef5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:01.152768 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3fc1d36b-3887-4f64-9d78-08f9a569bef5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:01.153715 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3fc1d36b-3887-4f64-9d78-08f9a569bef5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:01.154349 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3fc1d36b-3887-4f64-9d78-08f9a569bef5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:01.165194 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3fc1d36b-3887-4f64-9d78-08f9a569bef5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:01.444650 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-3fc1d36b-3887-4f64-9d78-08f9a569bef5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:01.463937 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-3fc1d36b-3887-4f64-9d78-08f9a569bef5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438" status: 200 len: 1300 microversion: 2.1 time: 0.344324 Aug 10 13:38:01.478631 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 15/26] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:01 2022] GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438 => generated 1300 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:01.764091 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-f5c84b31-0bd9-4d10-8aa3-35468f55801b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:01.764955 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-f5c84b31-0bd9-4d10-8aa3-35468f55801b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:01.783045 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f5c84b31-0bd9-4d10-8aa3-35468f55801b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:01.783554 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f5c84b31-0bd9-4d10-8aa3-35468f55801b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:01.783992 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f5c84b31-0bd9-4d10-8aa3-35468f55801b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:01.784899 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f5c84b31-0bd9-4d10-8aa3-35468f55801b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:01.785550 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f5c84b31-0bd9-4d10-8aa3-35468f55801b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:01.786128 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f5c84b31-0bd9-4d10-8aa3-35468f55801b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:01.973581 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-f5c84b31-0bd9-4d10-8aa3-35468f55801b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:01.982512 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-f5c84b31-0bd9-4d10-8aa3-35468f55801b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:01.990804 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-f5c84b31-0bd9-4d10-8aa3-35468f55801b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:01.993062 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-f5c84b31-0bd9-4d10-8aa3-35468f55801b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1340 microversion: 2.20 time: 0.232878 Aug 10 13:38:01.995068 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 16/27] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:38:01 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1340 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:38:02.013223 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-1efac466-38e0-4caf-9c46-f8e72e8fde72 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:02.015315 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-1efac466-38e0-4caf-9c46-f8e72e8fde72 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] [instance: a3e6b964-a4d5-4c24-8c8c-19373ddd2fff] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:02.021888 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1efac466-38e0-4caf-9c46-f8e72e8fde72 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:02.022634 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1efac466-38e0-4caf-9c46-f8e72e8fde72 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:02.023232 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1efac466-38e0-4caf-9c46-f8e72e8fde72 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:02.024624 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1efac466-38e0-4caf-9c46-f8e72e8fde72 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:02.028107 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1efac466-38e0-4caf-9c46-f8e72e8fde72 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:02.028842 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1efac466-38e0-4caf-9c46-f8e72e8fde72 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:02.504297 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-1efac466-38e0-4caf-9c46-f8e72e8fde72 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258ccb4bb15a4747b4c17d2a26645888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c99d576d184b04b933db13eabb8c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:02.513180 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-1efac466-38e0-4caf-9c46-f8e72e8fde72 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] 10.222.0.52 "GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff" status: 200 len: 1314 microversion: 2.1 time: 0.516564 Aug 10 13:38:02.521167 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 17/28] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:01 2022] GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff => generated 1314 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:02.537334 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-2b0592ef-6187-4ab5-975e-91339a449c2c tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:02.537953 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-2b0592ef-6187-4ab5-975e-91339a449c2c tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 41baab24-f648-4e7d-83bb-4357214ea438] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:02.570943 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2b0592ef-6187-4ab5-975e-91339a449c2c tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:02.571455 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2b0592ef-6187-4ab5-975e-91339a449c2c tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:02.571901 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2b0592ef-6187-4ab5-975e-91339a449c2c tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:02.578359 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2b0592ef-6187-4ab5-975e-91339a449c2c tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:02.578867 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2b0592ef-6187-4ab5-975e-91339a449c2c tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:02.579324 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2b0592ef-6187-4ab5-975e-91339a449c2c tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:03.012917 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-2b0592ef-6187-4ab5-975e-91339a449c2c tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:03.021140 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-2b0592ef-6187-4ab5-975e-91339a449c2c tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438" status: 200 len: 1300 microversion: 2.1 time: 0.498843 Aug 10 13:38:03.021812 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 18/29] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:02 2022] GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438 => generated 1300 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:03.065826 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-bad2188a-9eee-4ff9-ae61-b12b24581418 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:03.066382 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-bad2188a-9eee-4ff9-ae61-b12b24581418 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:03.105653 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-bad2188a-9eee-4ff9-ae61-b12b24581418 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:03.106410 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-bad2188a-9eee-4ff9-ae61-b12b24581418 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:03.107426 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-bad2188a-9eee-4ff9-ae61-b12b24581418 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:03.110247 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-bad2188a-9eee-4ff9-ae61-b12b24581418 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:03.110903 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-bad2188a-9eee-4ff9-ae61-b12b24581418 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:03.112680 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-bad2188a-9eee-4ff9-ae61-b12b24581418 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:03.498241 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-bad2188a-9eee-4ff9-ae61-b12b24581418 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:03.514023 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-bad2188a-9eee-4ff9-ae61-b12b24581418 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:03.520301 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-bad2188a-9eee-4ff9-ae61-b12b24581418 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:03.525437 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-bad2188a-9eee-4ff9-ae61-b12b24581418 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1340 microversion: 2.20 time: 0.483928 Aug 10 13:38:03.529459 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 19/30] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:38:03 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1340 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:38:03.545258 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-6e4e0d3b-ab21-42b0-a3d3-6c604001cea0 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:03.546259 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-6e4e0d3b-ab21-42b0-a3d3-6c604001cea0 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] [instance: a3e6b964-a4d5-4c24-8c8c-19373ddd2fff] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:03.558169 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6e4e0d3b-ab21-42b0-a3d3-6c604001cea0 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:03.558660 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6e4e0d3b-ab21-42b0-a3d3-6c604001cea0 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:03.560010 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6e4e0d3b-ab21-42b0-a3d3-6c604001cea0 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:03.560905 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6e4e0d3b-ab21-42b0-a3d3-6c604001cea0 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:03.561534 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6e4e0d3b-ab21-42b0-a3d3-6c604001cea0 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:03.562314 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6e4e0d3b-ab21-42b0-a3d3-6c604001cea0 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:03.743985 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-12becf59-3616-4271-9a70-4557ef58e174 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Flavor limits 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:38:03.745154 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-12becf59-3616-4271-9a70-4557ef58e174 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Image limits 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:38:03.745878 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-12becf59-3616-4271-9a70-4557ef58e174 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Flavor pref 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:38:03.746506 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-12becf59-3616-4271-9a70-4557ef58e174 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Image pref 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:38:03.747140 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-12becf59-3616-4271-9a70-4557ef58e174 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:38:03.770248 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-12becf59-3616-4271-9a70-4557ef58e174 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:03.780428 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-12becf59-3616-4271-9a70-4557ef58e174 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:03.782775 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-12becf59-3616-4271-9a70-4557ef58e174 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:03.783889 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-12becf59-3616-4271-9a70-4557ef58e174 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:03.784589 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-12becf59-3616-4271-9a70-4557ef58e174 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:03.785942 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-12becf59-3616-4271-9a70-4557ef58e174 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:03.833317 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-12becf59-3616-4271-9a70-4557ef58e174 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Getting quotas for project d8eda7c7d6a348e08e81a6b2496b09e5. Resources: {'cores', 'ram', 'instances'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:38:03.846452 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-12becf59-3616-4271-9a70-4557ef58e174 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Getting quotas for user 5573338f0bd64c729c7d89345069ca6f and project d8eda7c7d6a348e08e81a6b2496b09e5. Resources: {'cores', 'ram', 'instances'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:38:03.876386 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-12becf59-3616-4271-9a70-4557ef58e174 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Going to run 1 instances... {{(pid=129523) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:38:03.891590 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-12becf59-3616-4271-9a70-4557ef58e174 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='096d81df-12b1-4175-b914-babe0fa931c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:38:04.050537 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-12becf59-3616-4271-9a70-4557ef58e174 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.653501 Aug 10 13:38:04.051531 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 12/31] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 10 13:37:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 4655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 13:38:04.073217 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-f6a358c9-4ebe-45d6-9f21-f755c9928d24 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:04.076143 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-f6a358c9-4ebe-45d6-9f21-f755c9928d24 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 41baab24-f648-4e7d-83bb-4357214ea438] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:04.109822 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f6a358c9-4ebe-45d6-9f21-f755c9928d24 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:04.110325 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f6a358c9-4ebe-45d6-9f21-f755c9928d24 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:04.110823 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f6a358c9-4ebe-45d6-9f21-f755c9928d24 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:04.111486 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f6a358c9-4ebe-45d6-9f21-f755c9928d24 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:04.111942 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f6a358c9-4ebe-45d6-9f21-f755c9928d24 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:04.125084 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f6a358c9-4ebe-45d6-9f21-f755c9928d24 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:04.700993 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-6e4e0d3b-ab21-42b0-a3d3-6c604001cea0 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258ccb4bb15a4747b4c17d2a26645888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c99d576d184b04b933db13eabb8c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:04.711339 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-6e4e0d3b-ab21-42b0-a3d3-6c604001cea0 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] 10.222.0.52 "GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff" status: 200 len: 1314 microversion: 2.1 time: 1.170191 Aug 10 13:38:04.716445 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 20/32] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:03 2022] GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff => generated 1314 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:38:04.725394 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-3f90108b-0b5d-4a30-b326-f29129618afd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:04.728373 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-3f90108b-0b5d-4a30-b326-f29129618afd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:04.870577 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-3f90108b-0b5d-4a30-b326-f29129618afd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:04.880396 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-3f90108b-0b5d-4a30-b326-f29129618afd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1222 microversion: 2.1 time: 0.162553 Aug 10 13:38:04.895078 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 21/33] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:04 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1222 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:04.905977 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-eb6c413f-4364-4fd6-ac6d-1a3f73e9467d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:04.906791 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-eb6c413f-4364-4fd6-ac6d-1a3f73e9467d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:04.921823 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-eb6c413f-4364-4fd6-ac6d-1a3f73e9467d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:04.928591 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-eb6c413f-4364-4fd6-ac6d-1a3f73e9467d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:04.929216 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-eb6c413f-4364-4fd6-ac6d-1a3f73e9467d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:04.930172 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-eb6c413f-4364-4fd6-ac6d-1a3f73e9467d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:04.930774 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-eb6c413f-4364-4fd6-ac6d-1a3f73e9467d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:04.931359 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-eb6c413f-4364-4fd6-ac6d-1a3f73e9467d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:05.078112 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-f6a358c9-4ebe-45d6-9f21-f755c9928d24 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:05.101012 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-f6a358c9-4ebe-45d6-9f21-f755c9928d24 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438" status: 200 len: 1368 microversion: 2.1 time: 1.043321 Aug 10 13:38:05.104285 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 13/34] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:04 2022] GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438 => generated 1368 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:05.130599 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-eb6c413f-4364-4fd6-ac6d-1a3f73e9467d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:05.140997 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-eb6c413f-4364-4fd6-ac6d-1a3f73e9467d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:05.160340 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-eb6c413f-4364-4fd6-ac6d-1a3f73e9467d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:05.162645 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-eb6c413f-4364-4fd6-ac6d-1a3f73e9467d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1340 microversion: 2.20 time: 0.265140 Aug 10 13:38:05.165150 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 22/35] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:38:04 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1340 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:38:05.746579 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-b7f92e8e-9806-4526-9125-5f47467ce563 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:05.747184 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-b7f92e8e-9806-4526-9125-5f47467ce563 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] [instance: a3e6b964-a4d5-4c24-8c8c-19373ddd2fff] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:05.771907 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b7f92e8e-9806-4526-9125-5f47467ce563 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:05.777534 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b7f92e8e-9806-4526-9125-5f47467ce563 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:05.778153 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b7f92e8e-9806-4526-9125-5f47467ce563 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:05.778916 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b7f92e8e-9806-4526-9125-5f47467ce563 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:05.779401 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b7f92e8e-9806-4526-9125-5f47467ce563 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:05.796006 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b7f92e8e-9806-4526-9125-5f47467ce563 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:05.903849 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-e5a99439-7a24-4a19-947d-bfe1dbfee2fe tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:05.904621 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-e5a99439-7a24-4a19-947d-bfe1dbfee2fe tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:05.943696 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e5a99439-7a24-4a19-947d-bfe1dbfee2fe tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:05.944441 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e5a99439-7a24-4a19-947d-bfe1dbfee2fe tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:05.944997 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e5a99439-7a24-4a19-947d-bfe1dbfee2fe tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:05.953559 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e5a99439-7a24-4a19-947d-bfe1dbfee2fe tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:05.954043 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e5a99439-7a24-4a19-947d-bfe1dbfee2fe tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:05.954474 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e5a99439-7a24-4a19-947d-bfe1dbfee2fe tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:06.134947 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell0:SELECT=4 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:38:06.429178 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-e5a99439-7a24-4a19-947d-bfe1dbfee2fe tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:06.464822 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-e5a99439-7a24-4a19-947d-bfe1dbfee2fe tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1218 microversion: 2.1 time: 0.566272 Aug 10 13:38:06.472785 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 23/36] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:05 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1218 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:38:06.491348 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-1f3bb822-4c5e-4681-b089-9f2192b8b6eb tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:06.492301 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-1f3bb822-4c5e-4681-b089-9f2192b8b6eb tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 41baab24-f648-4e7d-83bb-4357214ea438] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:06.515048 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1f3bb822-4c5e-4681-b089-9f2192b8b6eb tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:06.515560 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1f3bb822-4c5e-4681-b089-9f2192b8b6eb tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:06.516011 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1f3bb822-4c5e-4681-b089-9f2192b8b6eb tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:06.516736 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1f3bb822-4c5e-4681-b089-9f2192b8b6eb tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:06.517191 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1f3bb822-4c5e-4681-b089-9f2192b8b6eb tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:06.517642 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1f3bb822-4c5e-4681-b089-9f2192b8b6eb tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:07.162793 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-1f3bb822-4c5e-4681-b089-9f2192b8b6eb tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:07.172477 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-1f3bb822-4c5e-4681-b089-9f2192b8b6eb tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438" status: 200 len: 1368 microversion: 2.1 time: 0.697212 Aug 10 13:38:07.178170 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 24/37] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:06 2022] GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438 => generated 1368 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:07.192203 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-fc5eaca9-c1c4-471e-807c-c5c0936c44e8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:07.192833 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-fc5eaca9-c1c4-471e-807c-c5c0936c44e8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:07.202735 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fc5eaca9-c1c4-471e-807c-c5c0936c44e8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:07.203447 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fc5eaca9-c1c4-471e-807c-c5c0936c44e8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:07.204062 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fc5eaca9-c1c4-471e-807c-c5c0936c44e8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:07.204963 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fc5eaca9-c1c4-471e-807c-c5c0936c44e8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:07.205596 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fc5eaca9-c1c4-471e-807c-c5c0936c44e8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:07.206167 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fc5eaca9-c1c4-471e-807c-c5c0936c44e8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:07.725526 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-fc5eaca9-c1c4-471e-807c-c5c0936c44e8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:07.747375 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-fc5eaca9-c1c4-471e-807c-c5c0936c44e8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:07.750490 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-fc5eaca9-c1c4-471e-807c-c5c0936c44e8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:07.758956 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-fc5eaca9-c1c4-471e-807c-c5c0936c44e8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1340 microversion: 2.20 time: 0.579503 Aug 10 13:38:07.762356 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 25/38] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:38:07 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1340 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:38:08.496869 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-dcbdb33c-380a-42f0-bddf-33718f414acc req-1de1751c-acf5-407a-8d61-25a8336c3ace service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3e6b964-a4d5-4c24-8c8c-19373ddd2fff", "tag": "c8823e05-42fa-4833-b852-78973a85cd31"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:38:08.525553 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-dcbdb33c-380a-42f0-bddf-33718f414acc req-1de1751c-acf5-407a-8d61-25a8336c3ace service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:08.526347 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-dcbdb33c-380a-42f0-bddf-33718f414acc req-1de1751c-acf5-407a-8d61-25a8336c3ace service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:08.527499 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-dcbdb33c-380a-42f0-bddf-33718f414acc req-1de1751c-acf5-407a-8d61-25a8336c3ace service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:08.583905 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-dcbdb33c-380a-42f0-bddf-33718f414acc req-1de1751c-acf5-407a-8d61-25a8336c3ace service nova] Creating event network-changed:c8823e05-42fa-4833-b852-78973a85cd31 for instance a3e6b964-a4d5-4c24-8c8c-19373ddd2fff on hv-cinder-85200 Aug 10 13:38:08.584748 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-dcbdb33c-380a-42f0-bddf-33718f414acc req-1de1751c-acf5-407a-8d61-25a8336c3ace service nova] Acquiring lock "compute-rpcapi-router" {{(pid=129522) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 13:38:08.592072 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-dcbdb33c-380a-42f0-bddf-33718f414acc req-1de1751c-acf5-407a-8d61-25a8336c3ace service nova] Acquired lock "compute-rpcapi-router" {{(pid=129522) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 13:38:08.593630 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1a9e764d-012b-41ea-a11b-6c347f7d9c0c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:08.594319 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1a9e764d-012b-41ea-a11b-6c347f7d9c0c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:08.594969 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1a9e764d-012b-41ea-a11b-6c347f7d9c0c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:08.595908 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1a9e764d-012b-41ea-a11b-6c347f7d9c0c None None] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:08.596965 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1a9e764d-012b-41ea-a11b-6c347f7d9c0c None None] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:08.597627 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1a9e764d-012b-41ea-a11b-6c347f7d9c0c None None] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:08.623625 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.compute.rpcapi [None req-1a9e764d-012b-41ea-a11b-6c347f7d9c0c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 10 13:38:08.626343 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1a9e764d-012b-41ea-a11b-6c347f7d9c0c None None] Releasing lock "compute-rpcapi-router" {{(pid=129522) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 13:38:08.661828 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-b7f92e8e-9806-4526-9125-5f47467ce563 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258ccb4bb15a4747b4c17d2a26645888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c99d576d184b04b933db13eabb8c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:08.677026 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-1a9e764d-012b-41ea-a11b-6c347f7d9c0c None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.913070 Aug 10 13:38:08.677967 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 26/39] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:38:08.683636 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-48e60eb8-c964-4f00-83d3-301966133e88 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:08.684382 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-b7f92e8e-9806-4526-9125-5f47467ce563 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] 10.222.0.52 "GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff" status: 200 len: 1314 microversion: 2.1 time: 2.933105 Aug 10 13:38:08.687916 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-48e60eb8-c964-4f00-83d3-301966133e88 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:08.706144 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 14/40] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:05 2022] GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff => generated 1314 bytes in 2965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:08.751382 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:38:08.761149 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-2c2ac4e3-97c8-494a-b5ba-6e02d6e3f667 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:08.764760 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-2c2ac4e3-97c8-494a-b5ba-6e02d6e3f667 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 41baab24-f648-4e7d-83bb-4357214ea438] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:08.765963 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-48e60eb8-c964-4f00-83d3-301966133e88 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:08.770444 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-48e60eb8-c964-4f00-83d3-301966133e88 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:08.771735 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-48e60eb8-c964-4f00-83d3-301966133e88 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:08.777477 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-48e60eb8-c964-4f00-83d3-301966133e88 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:08.790632 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-48e60eb8-c964-4f00-83d3-301966133e88 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:08.796881 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-48e60eb8-c964-4f00-83d3-301966133e88 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:08.805061 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2c2ac4e3-97c8-494a-b5ba-6e02d6e3f667 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:08.807041 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2c2ac4e3-97c8-494a-b5ba-6e02d6e3f667 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:08.809843 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2c2ac4e3-97c8-494a-b5ba-6e02d6e3f667 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:08.818174 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2c2ac4e3-97c8-494a-b5ba-6e02d6e3f667 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:08.819061 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2c2ac4e3-97c8-494a-b5ba-6e02d6e3f667 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:08.819613 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2c2ac4e3-97c8-494a-b5ba-6e02d6e3f667 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:08.835376 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell1:SELECT=100 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:38:09.065614 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-48e60eb8-c964-4f00-83d3-301966133e88 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:09.081083 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-48e60eb8-c964-4f00-83d3-301966133e88 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1280 microversion: 2.1 time: 0.399950 Aug 10 13:38:09.083808 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 27/41] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:08 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1280 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:09.113258 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-d908f07f-06ff-4ed1-864c-917ecb566292 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:09.116567 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-d908f07f-06ff-4ed1-864c-917ecb566292 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:09.143049 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d908f07f-06ff-4ed1-864c-917ecb566292 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:09.144008 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d908f07f-06ff-4ed1-864c-917ecb566292 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:09.145805 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d908f07f-06ff-4ed1-864c-917ecb566292 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:09.152032 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d908f07f-06ff-4ed1-864c-917ecb566292 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:09.156048 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d908f07f-06ff-4ed1-864c-917ecb566292 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:09.156681 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d908f07f-06ff-4ed1-864c-917ecb566292 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:09.596768 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-d908f07f-06ff-4ed1-864c-917ecb566292 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:09.612647 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-d908f07f-06ff-4ed1-864c-917ecb566292 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:09.617615 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-d908f07f-06ff-4ed1-864c-917ecb566292 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:09.621899 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-d908f07f-06ff-4ed1-864c-917ecb566292 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1408 microversion: 2.20 time: 0.533592 Aug 10 13:38:09.625055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 28/42] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:38:09 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1408 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:38:09.715058 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-28fba915-f238-44f8-ad40-c22fca0c2691 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:09.716220 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-28fba915-f238-44f8-ad40-c22fca0c2691 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] [instance: a3e6b964-a4d5-4c24-8c8c-19373ddd2fff] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:09.754393 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-28fba915-f238-44f8-ad40-c22fca0c2691 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:09.755694 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-28fba915-f238-44f8-ad40-c22fca0c2691 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:09.766567 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-28fba915-f238-44f8-ad40-c22fca0c2691 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:09.772109 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-28fba915-f238-44f8-ad40-c22fca0c2691 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:09.775188 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-28fba915-f238-44f8-ad40-c22fca0c2691 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:09.775649 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-28fba915-f238-44f8-ad40-c22fca0c2691 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:10.216613 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-2c2ac4e3-97c8-494a-b5ba-6e02d6e3f667 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:10.232832 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-2c2ac4e3-97c8-494a-b5ba-6e02d6e3f667 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438" status: 200 len: 1368 microversion: 2.1 time: 1.524693 Aug 10 13:38:10.233477 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 15/43] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:08 2022] GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438 => generated 1368 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:10.244015 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-754ff9d0-f8c7-497e-a938-c3a5ecff6d4c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:10.271525 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-754ff9d0-f8c7-497e-a938-c3a5ecff6d4c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:10.296944 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-754ff9d0-f8c7-497e-a938-c3a5ecff6d4c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:10.305729 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-28fba915-f238-44f8-ad40-c22fca0c2691 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258ccb4bb15a4747b4c17d2a26645888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c99d576d184b04b933db13eabb8c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:10.308039 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-754ff9d0-f8c7-497e-a938-c3a5ecff6d4c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:10.308507 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-754ff9d0-f8c7-497e-a938-c3a5ecff6d4c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:10.317749 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-28fba915-f238-44f8-ad40-c22fca0c2691 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] 10.222.0.52 "GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff" status: 200 len: 1314 microversion: 2.1 time: 0.608328 Aug 10 13:38:10.321308 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-754ff9d0-f8c7-497e-a938-c3a5ecff6d4c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:10.321863 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-754ff9d0-f8c7-497e-a938-c3a5ecff6d4c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:10.323748 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 29/44] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:09 2022] GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff => generated 1314 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:10.332134 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-754ff9d0-f8c7-497e-a938-c3a5ecff6d4c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:10.652001 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-7de6a845-8f0d-4384-bb92-a5870964bcad tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:10.653288 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-7de6a845-8f0d-4384-bb92-a5870964bcad tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:10.666724 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7de6a845-8f0d-4384-bb92-a5870964bcad tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:10.669214 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7de6a845-8f0d-4384-bb92-a5870964bcad tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:10.673287 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7de6a845-8f0d-4384-bb92-a5870964bcad tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:10.674785 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7de6a845-8f0d-4384-bb92-a5870964bcad tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:10.675425 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7de6a845-8f0d-4384-bb92-a5870964bcad tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:10.678545 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7de6a845-8f0d-4384-bb92-a5870964bcad tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:11.041936 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-754ff9d0-f8c7-497e-a938-c3a5ecff6d4c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:11.051618 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-754ff9d0-f8c7-497e-a938-c3a5ecff6d4c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1280 microversion: 2.1 time: 0.811769 Aug 10 13:38:11.054882 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 16/45] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:10 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1280 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:11.254967 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-78cb069f-f2b9-4072-871c-60a383247e09 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:11.255652 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-78cb069f-f2b9-4072-871c-60a383247e09 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 41baab24-f648-4e7d-83bb-4357214ea438] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:11.265765 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-78cb069f-f2b9-4072-871c-60a383247e09 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:11.266262 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-78cb069f-f2b9-4072-871c-60a383247e09 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:11.266697 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-78cb069f-f2b9-4072-871c-60a383247e09 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:11.273632 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-78cb069f-f2b9-4072-871c-60a383247e09 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:11.274990 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-78cb069f-f2b9-4072-871c-60a383247e09 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:11.275620 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-78cb069f-f2b9-4072-871c-60a383247e09 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:11.527953 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-7de6a845-8f0d-4384-bb92-a5870964bcad tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:11.540277 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-7de6a845-8f0d-4384-bb92-a5870964bcad tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:11.542037 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-7de6a845-8f0d-4384-bb92-a5870964bcad tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:11.546949 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-7de6a845-8f0d-4384-bb92-a5870964bcad tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1408 microversion: 2.20 time: 0.900557 Aug 10 13:38:11.548280 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 30/46] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:38:10 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1408 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:38:11.560555 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-a34a97f5-c05b-4f82-92e4-be01dfc6ef1e tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:11.564269 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-a34a97f5-c05b-4f82-92e4-be01dfc6ef1e tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] [instance: a3e6b964-a4d5-4c24-8c8c-19373ddd2fff] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:11.609277 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a34a97f5-c05b-4f82-92e4-be01dfc6ef1e tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:11.610805 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a34a97f5-c05b-4f82-92e4-be01dfc6ef1e tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:11.611406 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a34a97f5-c05b-4f82-92e4-be01dfc6ef1e tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:11.615596 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a34a97f5-c05b-4f82-92e4-be01dfc6ef1e tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:11.616503 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a34a97f5-c05b-4f82-92e4-be01dfc6ef1e tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:11.617458 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a34a97f5-c05b-4f82-92e4-be01dfc6ef1e tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:12.158847 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-a34a97f5-c05b-4f82-92e4-be01dfc6ef1e tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258ccb4bb15a4747b4c17d2a26645888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c99d576d184b04b933db13eabb8c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:12.172721 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-a34a97f5-c05b-4f82-92e4-be01dfc6ef1e tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] 10.222.0.52 "GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff" status: 200 len: 1314 microversion: 2.1 time: 0.622986 Aug 10 13:38:12.192437 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 31/47] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:11 2022] GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff => generated 1314 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:12.200027 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-7b0537a8-33d7-47f1-8369-429ee40fac27 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:12.206848 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-7b0537a8-33d7-47f1-8369-429ee40fac27 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:12.218814 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7b0537a8-33d7-47f1-8369-429ee40fac27 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:12.219317 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7b0537a8-33d7-47f1-8369-429ee40fac27 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:12.219757 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7b0537a8-33d7-47f1-8369-429ee40fac27 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:12.220474 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7b0537a8-33d7-47f1-8369-429ee40fac27 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:12.220932 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7b0537a8-33d7-47f1-8369-429ee40fac27 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:12.221395 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7b0537a8-33d7-47f1-8369-429ee40fac27 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:12.697491 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-7b0537a8-33d7-47f1-8369-429ee40fac27 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:12.705857 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-7b0537a8-33d7-47f1-8369-429ee40fac27 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1322 microversion: 2.1 time: 0.509655 Aug 10 13:38:12.709425 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 32/48] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:12 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1322 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:12.726000 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-7b944e4a-10a1-4bc7-b136-d65ee8111249 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:12.726905 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-7b944e4a-10a1-4bc7-b136-d65ee8111249 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:12.739823 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7b944e4a-10a1-4bc7-b136-d65ee8111249 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:12.740362 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7b944e4a-10a1-4bc7-b136-d65ee8111249 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:12.743369 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7b944e4a-10a1-4bc7-b136-d65ee8111249 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:12.744341 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7b944e4a-10a1-4bc7-b136-d65ee8111249 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:12.744987 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7b944e4a-10a1-4bc7-b136-d65ee8111249 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:12.746609 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7b944e4a-10a1-4bc7-b136-d65ee8111249 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:12.831638 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-78cb069f-f2b9-4072-871c-60a383247e09 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:12.841955 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-78cb069f-f2b9-4072-871c-60a383247e09 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438" status: 200 len: 1368 microversion: 2.1 time: 1.591184 Aug 10 13:38:12.854588 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 17/49] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:11 2022] GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438 => generated 1368 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:38:12.970710 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-7b944e4a-10a1-4bc7-b136-d65ee8111249 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:12.981921 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-7b944e4a-10a1-4bc7-b136-d65ee8111249 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:12.986035 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-7b944e4a-10a1-4bc7-b136-d65ee8111249 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:12.987659 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-7b944e4a-10a1-4bc7-b136-d65ee8111249 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1408 microversion: 2.20 time: 0.276827 Aug 10 13:38:12.988192 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 33/50] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:38:12 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1408 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:38:13.198944 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-274301d1-33c9-4779-9569-0d8f7462393d tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:13.199558 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-274301d1-33c9-4779-9569-0d8f7462393d tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] [instance: a3e6b964-a4d5-4c24-8c8c-19373ddd2fff] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:13.215798 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-274301d1-33c9-4779-9569-0d8f7462393d tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:13.216295 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-274301d1-33c9-4779-9569-0d8f7462393d tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:13.216919 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-274301d1-33c9-4779-9569-0d8f7462393d tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:13.217815 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-274301d1-33c9-4779-9569-0d8f7462393d tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:13.218421 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-274301d1-33c9-4779-9569-0d8f7462393d tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:13.218985 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-274301d1-33c9-4779-9569-0d8f7462393d tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:13.435153 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-65b6e22e-8a4e-48fc-9c5f-6431b06cc203 req-9d4af607-4003-4a45-9abe-0e11b3dfddc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41baab24-f648-4e7d-83bb-4357214ea438", "tag": "094ff493-e302-4b0c-96d5-f742648c5682"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:38:13.462334 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-65b6e22e-8a4e-48fc-9c5f-6431b06cc203 req-9d4af607-4003-4a45-9abe-0e11b3dfddc4 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:13.464590 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-65b6e22e-8a4e-48fc-9c5f-6431b06cc203 req-9d4af607-4003-4a45-9abe-0e11b3dfddc4 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:13.465370 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-65b6e22e-8a4e-48fc-9c5f-6431b06cc203 req-9d4af607-4003-4a45-9abe-0e11b3dfddc4 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:13.494105 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-65b6e22e-8a4e-48fc-9c5f-6431b06cc203 req-9d4af607-4003-4a45-9abe-0e11b3dfddc4 service nova] Creating event network-changed:094ff493-e302-4b0c-96d5-f742648c5682 for instance 41baab24-f648-4e7d-83bb-4357214ea438 on hv-cinder-85200 Aug 10 13:38:13.496378 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-65b6e22e-8a4e-48fc-9c5f-6431b06cc203 req-9d4af607-4003-4a45-9abe-0e11b3dfddc4 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=129523) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 13:38:13.498482 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-65b6e22e-8a4e-48fc-9c5f-6431b06cc203 req-9d4af607-4003-4a45-9abe-0e11b3dfddc4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129523) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 13:38:13.500236 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b6bcdf69-aff3-4c07-bec7-a1faad33c088 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:13.501044 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b6bcdf69-aff3-4c07-bec7-a1faad33c088 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:13.501658 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b6bcdf69-aff3-4c07-bec7-a1faad33c088 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:13.502682 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b6bcdf69-aff3-4c07-bec7-a1faad33c088 None None] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:13.503287 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b6bcdf69-aff3-4c07-bec7-a1faad33c088 None None] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:13.504080 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b6bcdf69-aff3-4c07-bec7-a1faad33c088 None None] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:13.519198 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.compute.rpcapi [None req-b6bcdf69-aff3-4c07-bec7-a1faad33c088 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 10 13:38:13.520094 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b6bcdf69-aff3-4c07-bec7-a1faad33c088 None None] Releasing lock "compute-rpcapi-router" {{(pid=129523) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 13:38:13.545620 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-b6bcdf69-aff3-4c07-bec7-a1faad33c088 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.560497 Aug 10 13:38:13.550133 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 18/51] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:38:13.556345 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-0a54d13f-2959-40a0-b38f-94b7bffabe51 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-87289627", "imageRef": "096d81df-12b1-4175-b914-babe0fa931c6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5e135556-dff2-48f9-a0d1-213f45a15473"}], "security_groups": [{"name": "tempest-securitygroup--289802489"}], "key_name": "tempest-keypair-386222063", "user_data": "}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:38:13.574750 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-274301d1-33c9-4779-9569-0d8f7462393d tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258ccb4bb15a4747b4c17d2a26645888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c99d576d184b04b933db13eabb8c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:13.590357 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-274301d1-33c9-4779-9569-0d8f7462393d tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] 10.222.0.52 "GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff" status: 200 len: 1314 microversion: 2.1 time: 0.394404 Aug 10 13:38:13.591556 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 34/52] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:13 2022] GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:13.734302 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-0aab4a51-9116-47eb-b3e7-e8286315fe06 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:13.735260 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-0aab4a51-9116-47eb-b3e7-e8286315fe06 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:13.747380 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0aab4a51-9116-47eb-b3e7-e8286315fe06 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:13.748382 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0aab4a51-9116-47eb-b3e7-e8286315fe06 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:13.749091 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0aab4a51-9116-47eb-b3e7-e8286315fe06 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:13.750191 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0aab4a51-9116-47eb-b3e7-e8286315fe06 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:13.750828 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0aab4a51-9116-47eb-b3e7-e8286315fe06 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:13.751412 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0aab4a51-9116-47eb-b3e7-e8286315fe06 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:13.865145 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell0:SELECT=26 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:38:13.928375 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.network.neutron [None req-0a54d13f-2959-40a0-b38f-94b7bffabe51 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] validate_networks() for [('5e135556-dff2-48f9-a0d1-213f45a15473', None, None, None, None, None)] {{(pid=129523) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:38:14.276365 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-0aab4a51-9116-47eb-b3e7-e8286315fe06 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:14.285222 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-0aab4a51-9116-47eb-b3e7-e8286315fe06 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1322 microversion: 2.1 time: 0.555229 Aug 10 13:38:14.307435 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 35/53] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:13 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1322 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:38:14.313255 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-1410a11f-1f42-479d-9a72-16d3866ced89 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:14.314362 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-1410a11f-1f42-479d-9a72-16d3866ced89 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 41baab24-f648-4e7d-83bb-4357214ea438] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:14.322986 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1410a11f-1f42-479d-9a72-16d3866ced89 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:14.324039 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1410a11f-1f42-479d-9a72-16d3866ced89 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:14.324822 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1410a11f-1f42-479d-9a72-16d3866ced89 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:14.325918 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1410a11f-1f42-479d-9a72-16d3866ced89 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:14.326689 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1410a11f-1f42-479d-9a72-16d3866ced89 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:14.327524 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1410a11f-1f42-479d-9a72-16d3866ced89 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:14.740885 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-1410a11f-1f42-479d-9a72-16d3866ced89 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:14.756014 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-1410a11f-1f42-479d-9a72-16d3866ced89 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438" status: 200 len: 1368 microversion: 2.1 time: 0.446388 Aug 10 13:38:14.757337 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 36/54] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:14 2022] GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438 => generated 1368 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:14.763415 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-086ac8b0-fabe-42c4-acbc-6123fe573bca req-8ef213aa-4e5d-454f-ac76-c4e62f42c1b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "783660b7-d622-4df6-85cd-56c623cc835e", "tag": "10c04e92-bea1-4ea3-9a28-b5ad9e2d1d12"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:38:14.779091 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-086ac8b0-fabe-42c4-acbc-6123fe573bca req-8ef213aa-4e5d-454f-ac76-c4e62f42c1b6 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:14.779809 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-086ac8b0-fabe-42c4-acbc-6123fe573bca req-8ef213aa-4e5d-454f-ac76-c4e62f42c1b6 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:14.780460 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-086ac8b0-fabe-42c4-acbc-6123fe573bca req-8ef213aa-4e5d-454f-ac76-c4e62f42c1b6 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:14.793822 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-086ac8b0-fabe-42c4-acbc-6123fe573bca req-8ef213aa-4e5d-454f-ac76-c4e62f42c1b6 service nova] Creating event network-changed:10c04e92-bea1-4ea3-9a28-b5ad9e2d1d12 for instance 783660b7-d622-4df6-85cd-56c623cc835e on hv-cinder-85200 Aug 10 13:38:14.802785 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-086ac8b0-fabe-42c4-acbc-6123fe573bca req-8ef213aa-4e5d-454f-ac76-c4e62f42c1b6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042849 Aug 10 13:38:14.804907 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 37/55] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:38:14.813086 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-7e4dc342-83ab-4c97-8b51-f85e0c1a2091 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:14.814319 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-7e4dc342-83ab-4c97-8b51-f85e0c1a2091 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:14.823685 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7e4dc342-83ab-4c97-8b51-f85e0c1a2091 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:14.824201 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7e4dc342-83ab-4c97-8b51-f85e0c1a2091 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:14.824822 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7e4dc342-83ab-4c97-8b51-f85e0c1a2091 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:14.826135 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7e4dc342-83ab-4c97-8b51-f85e0c1a2091 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:14.826802 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7e4dc342-83ab-4c97-8b51-f85e0c1a2091 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:14.827433 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7e4dc342-83ab-4c97-8b51-f85e0c1a2091 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:14.863177 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=10 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:38:14.879449 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell0:SELECT=20 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:38:15.281430 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-7e4dc342-83ab-4c97-8b51-f85e0c1a2091 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:15.292381 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-7e4dc342-83ab-4c97-8b51-f85e0c1a2091 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:15.298093 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-7e4dc342-83ab-4c97-8b51-f85e0c1a2091 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:15.304135 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-7e4dc342-83ab-4c97-8b51-f85e0c1a2091 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1408 microversion: 2.20 time: 0.497127 Aug 10 13:38:15.305342 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 38/56] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:38:14 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1408 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:38:15.313542 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-1b896191-032d-4f67-b574-d8c46429df0d tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:15.317369 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-1b896191-032d-4f67-b574-d8c46429df0d tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] [instance: a3e6b964-a4d5-4c24-8c8c-19373ddd2fff] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:15.338229 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1b896191-032d-4f67-b574-d8c46429df0d tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:15.340602 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1b896191-032d-4f67-b574-d8c46429df0d tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:15.341950 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1b896191-032d-4f67-b574-d8c46429df0d tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:15.344502 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1b896191-032d-4f67-b574-d8c46429df0d tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:15.348649 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1b896191-032d-4f67-b574-d8c46429df0d tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:15.349393 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1b896191-032d-4f67-b574-d8c46429df0d tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:15.389204 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-0a54d13f-2959-40a0-b38f-94b7bffabe51 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Flavor limits 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:38:15.390301 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-0a54d13f-2959-40a0-b38f-94b7bffabe51 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Image limits 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:38:15.390939 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-0a54d13f-2959-40a0-b38f-94b7bffabe51 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Flavor pref 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:38:15.391491 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-0a54d13f-2959-40a0-b38f-94b7bffabe51 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Image pref 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:38:15.392096 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-0a54d13f-2959-40a0-b38f-94b7bffabe51 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:38:15.413497 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0a54d13f-2959-40a0-b38f-94b7bffabe51 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:15.416904 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0a54d13f-2959-40a0-b38f-94b7bffabe51 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:15.419213 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0a54d13f-2959-40a0-b38f-94b7bffabe51 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:15.422787 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0a54d13f-2959-40a0-b38f-94b7bffabe51 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:15.423518 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0a54d13f-2959-40a0-b38f-94b7bffabe51 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:15.426544 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0a54d13f-2959-40a0-b38f-94b7bffabe51 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:15.447884 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell0:SELECT=9 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:38:15.449837 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell1:SELECT=53 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:38:15.490621 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-0a54d13f-2959-40a0-b38f-94b7bffabe51 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Getting quotas for project 6f889848d459459484b5b5517fef576b. Resources: {'cores', 'ram', 'instances'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:38:15.495713 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-0a54d13f-2959-40a0-b38f-94b7bffabe51 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Getting quotas for user 289c7d8b89cd445a924f5ac07e85fe48 and project 6f889848d459459484b5b5517fef576b. Resources: {'cores', 'ram', 'instances'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:38:15.516762 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-0a54d13f-2959-40a0-b38f-94b7bffabe51 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Going to run 1 instances... {{(pid=129523) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:38:15.522534 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-0a54d13f-2959-40a0-b38f-94b7bffabe51 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='096d81df-12b1-4175-b914-babe0fa931c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:38:15.649028 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-0a54d13f-2959-40a0-b38f-94b7bffabe51 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.097594 Aug 10 13:38:15.650891 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 19/57] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 10 13:38:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 2100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 13:38:15.659605 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-52843c30-2856-4e13-a7e3-dacd8b406d43 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:15.663622 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-52843c30-2856-4e13-a7e3-dacd8b406d43 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:15.683620 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-52843c30-2856-4e13-a7e3-dacd8b406d43 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:15.684356 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-52843c30-2856-4e13-a7e3-dacd8b406d43 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:15.685713 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-52843c30-2856-4e13-a7e3-dacd8b406d43 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:15.686498 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-52843c30-2856-4e13-a7e3-dacd8b406d43 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:15.686971 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-52843c30-2856-4e13-a7e3-dacd8b406d43 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:15.687401 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-52843c30-2856-4e13-a7e3-dacd8b406d43 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:16.032401 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-1b896191-032d-4f67-b574-d8c46429df0d tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258ccb4bb15a4747b4c17d2a26645888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c99d576d184b04b933db13eabb8c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:16.042479 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-1b896191-032d-4f67-b574-d8c46429df0d tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] 10.222.0.52 "GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff" status: 200 len: 1314 microversion: 2.1 time: 0.734760 Aug 10 13:38:16.044201 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 39/58] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:15 2022] GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff => generated 1314 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:16.062561 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-0747c963-685f-447e-bcc4-81662dced8d6 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:16.063457 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-0747c963-685f-447e-bcc4-81662dced8d6 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:16.184816 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-0747c963-685f-447e-bcc4-81662dced8d6 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:16.199040 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-52843c30-2856-4e13-a7e3-dacd8b406d43 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:16.221599 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-52843c30-2856-4e13-a7e3-dacd8b406d43 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1322 microversion: 2.1 time: 0.568375 Aug 10 13:38:16.222360 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-0747c963-685f-447e-bcc4-81662dced8d6 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1235 microversion: 2.1 time: 0.158853 Aug 10 13:38:16.223324 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 40/59] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:16 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1235 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:16.244542 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 20/60] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:15 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1322 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:16.256178 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-a8be19b9-beda-42d2-a2e8-fc159db176f6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:16.260862 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-c530f2a2-366a-452c-a1a3-29e7a7075b79 req-e7ea57d4-1837-479a-b18e-82b97920ead8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdba9a34-3f3e-4314-a377-e6dc259c27cb", "tag": "3fd93ef8-553f-4b67-8470-c80fc47f7c94"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:38:16.262432 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-a8be19b9-beda-42d2-a2e8-fc159db176f6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 41baab24-f648-4e7d-83bb-4357214ea438] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:16.284327 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a8be19b9-beda-42d2-a2e8-fc159db176f6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:16.286009 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a8be19b9-beda-42d2-a2e8-fc159db176f6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:16.286700 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a8be19b9-beda-42d2-a2e8-fc159db176f6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:16.290420 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a8be19b9-beda-42d2-a2e8-fc159db176f6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:16.291100 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a8be19b9-beda-42d2-a2e8-fc159db176f6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:16.295150 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a8be19b9-beda-42d2-a2e8-fc159db176f6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:16.310652 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-c530f2a2-366a-452c-a1a3-29e7a7075b79 req-e7ea57d4-1837-479a-b18e-82b97920ead8 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:16.311392 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-c530f2a2-366a-452c-a1a3-29e7a7075b79 req-e7ea57d4-1837-479a-b18e-82b97920ead8 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:16.312007 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-c530f2a2-366a-452c-a1a3-29e7a7075b79 req-e7ea57d4-1837-479a-b18e-82b97920ead8 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:16.347566 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-c530f2a2-366a-452c-a1a3-29e7a7075b79 req-e7ea57d4-1837-479a-b18e-82b97920ead8 service nova] Creating event network-changed:3fd93ef8-553f-4b67-8470-c80fc47f7c94 for instance cdba9a34-3f3e-4314-a377-e6dc259c27cb on hv-cinder-85200 Aug 10 13:38:16.353783 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-c530f2a2-366a-452c-a1a3-29e7a7075b79 req-e7ea57d4-1837-479a-b18e-82b97920ead8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107587 Aug 10 13:38:16.354914 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 21/61] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:38:16.360342 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-18a997cc-ebd4-45c6-a92b-27867f70cdbe tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:16.361917 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-18a997cc-ebd4-45c6-a92b-27867f70cdbe tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:16.370546 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-18a997cc-ebd4-45c6-a92b-27867f70cdbe tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:16.371155 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-18a997cc-ebd4-45c6-a92b-27867f70cdbe tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:16.371839 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-18a997cc-ebd4-45c6-a92b-27867f70cdbe tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:16.372746 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-18a997cc-ebd4-45c6-a92b-27867f70cdbe tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:16.373413 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-18a997cc-ebd4-45c6-a92b-27867f70cdbe tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:16.373947 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-18a997cc-ebd4-45c6-a92b-27867f70cdbe tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:16.553161 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-a8be19b9-beda-42d2-a2e8-fc159db176f6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:16.576474 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-a8be19b9-beda-42d2-a2e8-fc159db176f6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438" status: 200 len: 1368 microversion: 2.1 time: 0.350733 Aug 10 13:38:16.587785 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 41/62] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:16 2022] GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438 => generated 1368 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:16.831963 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-18a997cc-ebd4-45c6-a92b-27867f70cdbe tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:16.849933 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-18a997cc-ebd4-45c6-a92b-27867f70cdbe tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:16.853632 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-18a997cc-ebd4-45c6-a92b-27867f70cdbe tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:16.875623 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-18a997cc-ebd4-45c6-a92b-27867f70cdbe tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1408 microversion: 2.20 time: 0.517894 Aug 10 13:38:16.882148 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 22/63] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:38:16 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1408 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:38:17.065893 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-29dc6a49-61ab-442d-9bd7-58da57cd83bb tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:17.066652 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-29dc6a49-61ab-442d-9bd7-58da57cd83bb tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] [instance: a3e6b964-a4d5-4c24-8c8c-19373ddd2fff] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:17.075789 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-29dc6a49-61ab-442d-9bd7-58da57cd83bb tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:17.079638 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-29dc6a49-61ab-442d-9bd7-58da57cd83bb tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:17.080485 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-29dc6a49-61ab-442d-9bd7-58da57cd83bb tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:17.084399 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-29dc6a49-61ab-442d-9bd7-58da57cd83bb tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:17.086782 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-29dc6a49-61ab-442d-9bd7-58da57cd83bb tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:17.091171 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-29dc6a49-61ab-442d-9bd7-58da57cd83bb tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:17.253775 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-3bda8c78-f555-4e34-a9e2-283ddb59b418 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:17.253775 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-3bda8c78-f555-4e34-a9e2-283ddb59b418 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:17.285544 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3bda8c78-f555-4e34-a9e2-283ddb59b418 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:17.286184 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3bda8c78-f555-4e34-a9e2-283ddb59b418 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:17.286631 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3bda8c78-f555-4e34-a9e2-283ddb59b418 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:17.298430 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3bda8c78-f555-4e34-a9e2-283ddb59b418 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:17.299060 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3bda8c78-f555-4e34-a9e2-283ddb59b418 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:17.314975 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3bda8c78-f555-4e34-a9e2-283ddb59b418 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:17.603983 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-29dc6a49-61ab-442d-9bd7-58da57cd83bb tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258ccb4bb15a4747b4c17d2a26645888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c99d576d184b04b933db13eabb8c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:17.616565 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-29dc6a49-61ab-442d-9bd7-58da57cd83bb tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] 10.222.0.52 "GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff" status: 200 len: 1314 microversion: 2.1 time: 0.554883 Aug 10 13:38:17.618993 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 42/64] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:17 2022] GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff => generated 1314 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:17.624650 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-a35fa63b-9389-412a-bf86-5078f14f15db tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:17.626465 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-a35fa63b-9389-412a-bf86-5078f14f15db tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:17.638220 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a35fa63b-9389-412a-bf86-5078f14f15db tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:17.639376 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a35fa63b-9389-412a-bf86-5078f14f15db tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:17.640744 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a35fa63b-9389-412a-bf86-5078f14f15db tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:17.641664 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a35fa63b-9389-412a-bf86-5078f14f15db tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:17.642261 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a35fa63b-9389-412a-bf86-5078f14f15db tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:17.642838 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a35fa63b-9389-412a-bf86-5078f14f15db tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:17.795374 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-3bda8c78-f555-4e34-a9e2-283ddb59b418 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:17.803047 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-3bda8c78-f555-4e34-a9e2-283ddb59b418 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1231 microversion: 2.1 time: 0.557759 Aug 10 13:38:17.809363 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 23/65] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:17 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1231 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:17.820492 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-43ba33d6-7173-4821-92af-8bc4576ec4ea tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:17.823230 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-43ba33d6-7173-4821-92af-8bc4576ec4ea tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 41baab24-f648-4e7d-83bb-4357214ea438] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:17.836398 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-43ba33d6-7173-4821-92af-8bc4576ec4ea tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:17.839701 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-43ba33d6-7173-4821-92af-8bc4576ec4ea tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:17.840385 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-43ba33d6-7173-4821-92af-8bc4576ec4ea tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:17.841371 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-43ba33d6-7173-4821-92af-8bc4576ec4ea tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:17.843300 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-43ba33d6-7173-4821-92af-8bc4576ec4ea tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:17.845523 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-43ba33d6-7173-4821-92af-8bc4576ec4ea tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:18.199608 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-a35fa63b-9389-412a-bf86-5078f14f15db tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:18.209618 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-a35fa63b-9389-412a-bf86-5078f14f15db tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1322 microversion: 2.1 time: 0.589036 Aug 10 13:38:18.213088 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 43/66] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:17 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1322 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:18.223921 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-a30037cd-f836-4b0f-b9d4-7192e81becb0 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:18.225793 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-a30037cd-f836-4b0f-b9d4-7192e81becb0 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:18.242738 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a30037cd-f836-4b0f-b9d4-7192e81becb0 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:18.247477 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a30037cd-f836-4b0f-b9d4-7192e81becb0 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:18.248144 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a30037cd-f836-4b0f-b9d4-7192e81becb0 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:18.250036 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a30037cd-f836-4b0f-b9d4-7192e81becb0 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:18.254802 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a30037cd-f836-4b0f-b9d4-7192e81becb0 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:18.257948 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a30037cd-f836-4b0f-b9d4-7192e81becb0 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:18.623005 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell0:SELECT=2 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:38:18.910616 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-a30037cd-f836-4b0f-b9d4-7192e81becb0 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:18.937764 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-a30037cd-f836-4b0f-b9d4-7192e81becb0 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:18.939336 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-a30037cd-f836-4b0f-b9d4-7192e81becb0 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:18.942414 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-a30037cd-f836-4b0f-b9d4-7192e81becb0 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1408 microversion: 2.20 time: 0.728103 Aug 10 13:38:18.965689 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 44/67] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:38:18 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1408 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:38:19.051410 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-43ba33d6-7173-4821-92af-8bc4576ec4ea tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:19.060612 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-43ba33d6-7173-4821-92af-8bc4576ec4ea tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438" status: 200 len: 1368 microversion: 2.1 time: 1.249319 Aug 10 13:38:19.066098 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 24/68] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:17 2022] GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438 => generated 1368 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:19.075563 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-4ef82109-1543-4423-9e68-aad9d78d5425 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:19.076440 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-4ef82109-1543-4423-9e68-aad9d78d5425 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] [instance: a3e6b964-a4d5-4c24-8c8c-19373ddd2fff] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:19.091913 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4ef82109-1543-4423-9e68-aad9d78d5425 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:19.092432 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4ef82109-1543-4423-9e68-aad9d78d5425 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:19.092887 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4ef82109-1543-4423-9e68-aad9d78d5425 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:19.098252 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4ef82109-1543-4423-9e68-aad9d78d5425 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:19.098777 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4ef82109-1543-4423-9e68-aad9d78d5425 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:19.099302 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4ef82109-1543-4423-9e68-aad9d78d5425 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:19.193847 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-291f6bd8-070e-4ee2-9e84-6e40242abbae req-b57acb65-889b-4e35-b308-8bd42b24e72d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3e6b964-a4d5-4c24-8c8c-19373ddd2fff", "name": "network-vif-plugged", "status": "completed", "tag": "c8823e05-42fa-4833-b852-78973a85cd31"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:38:19.207135 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-291f6bd8-070e-4ee2-9e84-6e40242abbae req-b57acb65-889b-4e35-b308-8bd42b24e72d service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:19.211591 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-291f6bd8-070e-4ee2-9e84-6e40242abbae req-b57acb65-889b-4e35-b308-8bd42b24e72d service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:19.212331 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-291f6bd8-070e-4ee2-9e84-6e40242abbae req-b57acb65-889b-4e35-b308-8bd42b24e72d service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:19.253602 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-291f6bd8-070e-4ee2-9e84-6e40242abbae req-b57acb65-889b-4e35-b308-8bd42b24e72d service nova] Creating event network-vif-plugged:c8823e05-42fa-4833-b852-78973a85cd31 for instance a3e6b964-a4d5-4c24-8c8c-19373ddd2fff on hv-cinder-85200 Aug 10 13:38:19.260874 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-291f6bd8-070e-4ee2-9e84-6e40242abbae req-b57acb65-889b-4e35-b308-8bd42b24e72d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.293754 Aug 10 13:38:19.264852 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 45/69] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:38:19.270806 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-473ed783-67a9-4773-a9a7-916d1a93a7e7 req-dc6c3bef-a939-4867-a039-655364f2a8d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9107fc16-6a2c-48ad-8612-964c3ac05c01", "tag": "ce8bc99b-8473-443a-affd-c91a70f09259"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:38:19.329539 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-473ed783-67a9-4773-a9a7-916d1a93a7e7 req-dc6c3bef-a939-4867-a039-655364f2a8d2 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:19.330473 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-473ed783-67a9-4773-a9a7-916d1a93a7e7 req-dc6c3bef-a939-4867-a039-655364f2a8d2 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:19.331312 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-473ed783-67a9-4773-a9a7-916d1a93a7e7 req-dc6c3bef-a939-4867-a039-655364f2a8d2 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:19.337451 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell1:SELECT=100 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:38:19.347227 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-473ed783-67a9-4773-a9a7-916d1a93a7e7 req-dc6c3bef-a939-4867-a039-655364f2a8d2 service nova] Creating event network-changed:ce8bc99b-8473-443a-affd-c91a70f09259 for instance 9107fc16-6a2c-48ad-8612-964c3ac05c01 on hv-cinder-85200 Aug 10 13:38:19.361952 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-473ed783-67a9-4773-a9a7-916d1a93a7e7 req-dc6c3bef-a939-4867-a039-655364f2a8d2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088730 Aug 10 13:38:19.363485 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 46/70] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:38:19.368981 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-62a06761-a04a-4309-b9e2-c50005a7c302 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:19.369930 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-62a06761-a04a-4309-b9e2-c50005a7c302 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:19.378139 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-62a06761-a04a-4309-b9e2-c50005a7c302 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:19.378857 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-62a06761-a04a-4309-b9e2-c50005a7c302 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:19.379446 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-62a06761-a04a-4309-b9e2-c50005a7c302 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:19.380280 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-62a06761-a04a-4309-b9e2-c50005a7c302 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:19.381107 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-62a06761-a04a-4309-b9e2-c50005a7c302 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:19.381830 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-62a06761-a04a-4309-b9e2-c50005a7c302 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:19.779733 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-62a06761-a04a-4309-b9e2-c50005a7c302 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:19.792213 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-62a06761-a04a-4309-b9e2-c50005a7c302 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1293 microversion: 2.1 time: 0.427298 Aug 10 13:38:19.811395 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 47/71] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:19 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1293 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:19.820331 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-45a53f59-c02d-4eeb-91f2-9c7db8251491 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:19.820955 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-45a53f59-c02d-4eeb-91f2-9c7db8251491 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:19.845169 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-45a53f59-c02d-4eeb-91f2-9c7db8251491 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:19.845996 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-45a53f59-c02d-4eeb-91f2-9c7db8251491 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:19.846622 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-45a53f59-c02d-4eeb-91f2-9c7db8251491 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:19.850566 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-45a53f59-c02d-4eeb-91f2-9c7db8251491 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:19.852034 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-45a53f59-c02d-4eeb-91f2-9c7db8251491 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:19.852669 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-45a53f59-c02d-4eeb-91f2-9c7db8251491 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:20.084764 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-45a53f59-c02d-4eeb-91f2-9c7db8251491 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:20.092735 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-45a53f59-c02d-4eeb-91f2-9c7db8251491 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1322 microversion: 2.1 time: 0.280010 Aug 10 13:38:20.105269 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 48/72] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:19 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1322 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:20.122405 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-f43c3ffe-b9a3-46f5-abd9-9013f56aadff tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:20.123221 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-f43c3ffe-b9a3-46f5-abd9-9013f56aadff tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:20.141622 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f43c3ffe-b9a3-46f5-abd9-9013f56aadff tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:20.147371 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f43c3ffe-b9a3-46f5-abd9-9013f56aadff tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:20.148852 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f43c3ffe-b9a3-46f5-abd9-9013f56aadff tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:20.152626 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f43c3ffe-b9a3-46f5-abd9-9013f56aadff tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:20.154397 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f43c3ffe-b9a3-46f5-abd9-9013f56aadff tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:20.155071 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f43c3ffe-b9a3-46f5-abd9-9013f56aadff tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:20.511394 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-f43c3ffe-b9a3-46f5-abd9-9013f56aadff tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:20.520547 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-f43c3ffe-b9a3-46f5-abd9-9013f56aadff tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:20.525423 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-f43c3ffe-b9a3-46f5-abd9-9013f56aadff tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:20.527970 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-f43c3ffe-b9a3-46f5-abd9-9013f56aadff tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1408 microversion: 2.20 time: 0.433867 Aug 10 13:38:20.530131 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 49/73] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:38:20 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1408 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:38:20.541828 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-12b958dc-1428-4b06-9c08-ebb558a11a0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:20.542639 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-12b958dc-1428-4b06-9c08-ebb558a11a0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 41baab24-f648-4e7d-83bb-4357214ea438] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:20.561594 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-12b958dc-1428-4b06-9c08-ebb558a11a0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:20.563143 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-12b958dc-1428-4b06-9c08-ebb558a11a0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:20.563765 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-12b958dc-1428-4b06-9c08-ebb558a11a0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:20.568233 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-12b958dc-1428-4b06-9c08-ebb558a11a0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:20.569204 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-12b958dc-1428-4b06-9c08-ebb558a11a0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:20.570004 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-12b958dc-1428-4b06-9c08-ebb558a11a0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:20.680275 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-4ef82109-1543-4423-9e68-aad9d78d5425 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258ccb4bb15a4747b4c17d2a26645888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c99d576d184b04b933db13eabb8c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:20.689245 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-4ef82109-1543-4423-9e68-aad9d78d5425 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] 10.222.0.52 "GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff" status: 200 len: 1314 microversion: 2.1 time: 1.621705 Aug 10 13:38:20.696368 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 25/74] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:19 2022] GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff => generated 1314 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:20.815651 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-b40b2170-aa59-4e0f-abea-a2c9c959cd38 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:20.816646 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-b40b2170-aa59-4e0f-abea-a2c9c959cd38 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:20.824470 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b40b2170-aa59-4e0f-abea-a2c9c959cd38 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:20.826920 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b40b2170-aa59-4e0f-abea-a2c9c959cd38 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:20.828145 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b40b2170-aa59-4e0f-abea-a2c9c959cd38 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:20.833532 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b40b2170-aa59-4e0f-abea-a2c9c959cd38 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:20.834229 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b40b2170-aa59-4e0f-abea-a2c9c959cd38 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:20.834803 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b40b2170-aa59-4e0f-abea-a2c9c959cd38 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:20.839359 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-12b958dc-1428-4b06-9c08-ebb558a11a0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:20.850366 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-12b958dc-1428-4b06-9c08-ebb558a11a0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438" status: 200 len: 1368 microversion: 2.1 time: 0.314728 Aug 10 13:38:20.868929 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 50/75] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:20 2022] GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438 => generated 1368 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:21.129265 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-a35df8a1-14dd-4a0c-a4b4-b1b04ef8b9f8 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:21.130593 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-a35df8a1-14dd-4a0c-a4b4-b1b04ef8b9f8 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:21.141049 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a35df8a1-14dd-4a0c-a4b4-b1b04ef8b9f8 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:21.142481 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a35df8a1-14dd-4a0c-a4b4-b1b04ef8b9f8 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:21.143052 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a35df8a1-14dd-4a0c-a4b4-b1b04ef8b9f8 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:21.143931 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a35df8a1-14dd-4a0c-a4b4-b1b04ef8b9f8 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:21.144497 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a35df8a1-14dd-4a0c-a4b4-b1b04ef8b9f8 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:21.145158 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a35df8a1-14dd-4a0c-a4b4-b1b04ef8b9f8 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:21.499744 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-a35df8a1-14dd-4a0c-a4b4-b1b04ef8b9f8 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:21.517571 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-a35df8a1-14dd-4a0c-a4b4-b1b04ef8b9f8 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1322 microversion: 2.1 time: 0.402343 Aug 10 13:38:21.518806 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 51/76] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:21 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1322 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:21.524897 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-d7ce47b6-3cf1-44ce-8c3f-775d3636c5c7 req-2a37e109-d652-4e77-9ff2-30296f1cbac3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41baab24-f648-4e7d-83bb-4357214ea438", "name": "network-vif-plugged", "status": "completed", "tag": "094ff493-e302-4b0c-96d5-f742648c5682"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:38:21.536291 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-d7ce47b6-3cf1-44ce-8c3f-775d3636c5c7 req-2a37e109-d652-4e77-9ff2-30296f1cbac3 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:21.537035 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-d7ce47b6-3cf1-44ce-8c3f-775d3636c5c7 req-2a37e109-d652-4e77-9ff2-30296f1cbac3 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:21.537693 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-d7ce47b6-3cf1-44ce-8c3f-775d3636c5c7 req-2a37e109-d652-4e77-9ff2-30296f1cbac3 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:21.552932 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-d7ce47b6-3cf1-44ce-8c3f-775d3636c5c7 req-2a37e109-d652-4e77-9ff2-30296f1cbac3 service nova] Creating event network-vif-plugged:094ff493-e302-4b0c-96d5-f742648c5682 for instance 41baab24-f648-4e7d-83bb-4357214ea438 on hv-cinder-85200 Aug 10 13:38:21.559926 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-d7ce47b6-3cf1-44ce-8c3f-775d3636c5c7 req-2a37e109-d652-4e77-9ff2-30296f1cbac3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039457 Aug 10 13:38:21.562095 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 52/77] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:38:21.568383 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-8c2b7d05-f564-4825-b78c-05e9eb27b59f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:21.569926 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-8c2b7d05-f564-4825-b78c-05e9eb27b59f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:21.577462 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8c2b7d05-f564-4825-b78c-05e9eb27b59f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:21.578177 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8c2b7d05-f564-4825-b78c-05e9eb27b59f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:21.578758 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8c2b7d05-f564-4825-b78c-05e9eb27b59f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:21.580077 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8c2b7d05-f564-4825-b78c-05e9eb27b59f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:21.580767 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8c2b7d05-f564-4825-b78c-05e9eb27b59f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:21.581369 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8c2b7d05-f564-4825-b78c-05e9eb27b59f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:21.894021 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-8c2b7d05-f564-4825-b78c-05e9eb27b59f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:21.904011 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-8c2b7d05-f564-4825-b78c-05e9eb27b59f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:21.906157 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-8c2b7d05-f564-4825-b78c-05e9eb27b59f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:21.907528 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-8c2b7d05-f564-4825-b78c-05e9eb27b59f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1408 microversion: 2.20 time: 0.344017 Aug 10 13:38:21.917296 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 53/78] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:38:21 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1408 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:38:21.917296 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-05af5edf-4257-47d5-abf9-ec2f81b18c43 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:21.917296 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-05af5edf-4257-47d5-abf9-ec2f81b18c43 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] [instance: a3e6b964-a4d5-4c24-8c8c-19373ddd2fff] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:21.918780 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-b40b2170-aa59-4e0f-abea-a2c9c959cd38 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:21.924563 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-05af5edf-4257-47d5-abf9-ec2f81b18c43 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:21.925044 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-05af5edf-4257-47d5-abf9-ec2f81b18c43 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:21.925501 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-05af5edf-4257-47d5-abf9-ec2f81b18c43 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:21.926194 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-05af5edf-4257-47d5-abf9-ec2f81b18c43 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:21.926638 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-05af5edf-4257-47d5-abf9-ec2f81b18c43 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:21.927052 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-05af5edf-4257-47d5-abf9-ec2f81b18c43 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:21.937920 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-b40b2170-aa59-4e0f-abea-a2c9c959cd38 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1360 microversion: 2.1 time: 1.127313 Aug 10 13:38:21.939681 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 26/79] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:20 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1360 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:38:21.945820 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-fdedefdc-7e97-4da1-8af8-6da81ac4506b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:21.946668 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-fdedefdc-7e97-4da1-8af8-6da81ac4506b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 41baab24-f648-4e7d-83bb-4357214ea438] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:21.957277 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-fdedefdc-7e97-4da1-8af8-6da81ac4506b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:21.958031 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-fdedefdc-7e97-4da1-8af8-6da81ac4506b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:21.958964 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-fdedefdc-7e97-4da1-8af8-6da81ac4506b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:21.960768 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-fdedefdc-7e97-4da1-8af8-6da81ac4506b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:21.961882 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-fdedefdc-7e97-4da1-8af8-6da81ac4506b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:21.962538 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-fdedefdc-7e97-4da1-8af8-6da81ac4506b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:22.138964 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-05af5edf-4257-47d5-abf9-ec2f81b18c43 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258ccb4bb15a4747b4c17d2a26645888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c99d576d184b04b933db13eabb8c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:22.151405 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-05af5edf-4257-47d5-abf9-ec2f81b18c43 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] 10.222.0.52 "GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff" status: 200 len: 1314 microversion: 2.1 time: 0.241200 Aug 10 13:38:22.154525 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 54/80] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:21 2022] GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:22.179666 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-c51ecbe3-bb49-4e0a-a257-a7f2b9628d4c req-89450e2c-861e-42c2-b3bf-1ea1bc24a562 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "589498ff-2901-49e5-91c2-0275f4dcf522", "tag": "55a42d5a-6bbe-4f41-9140-ed498c4f571f"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:38:22.207993 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-c51ecbe3-bb49-4e0a-a257-a7f2b9628d4c req-89450e2c-861e-42c2-b3bf-1ea1bc24a562 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:22.208488 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-c51ecbe3-bb49-4e0a-a257-a7f2b9628d4c req-89450e2c-861e-42c2-b3bf-1ea1bc24a562 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:22.208908 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-c51ecbe3-bb49-4e0a-a257-a7f2b9628d4c req-89450e2c-861e-42c2-b3bf-1ea1bc24a562 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:22.223681 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-c51ecbe3-bb49-4e0a-a257-a7f2b9628d4c req-89450e2c-861e-42c2-b3bf-1ea1bc24a562 service nova] Creating event network-changed:55a42d5a-6bbe-4f41-9140-ed498c4f571f for instance 589498ff-2901-49e5-91c2-0275f4dcf522 on hv-cinder-85200 Aug 10 13:38:22.231621 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-c51ecbe3-bb49-4e0a-a257-a7f2b9628d4c req-89450e2c-861e-42c2-b3bf-1ea1bc24a562 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071574 Aug 10 13:38:22.232075 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 55/81] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:38:22.490103 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-fdedefdc-7e97-4da1-8af8-6da81ac4506b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:22.499249 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-fdedefdc-7e97-4da1-8af8-6da81ac4506b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438" status: 200 len: 1368 microversion: 2.1 time: 0.558206 Aug 10 13:38:22.500075 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 27/82] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:21 2022] GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438 => generated 1368 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:22.545278 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-9ff6783a-fd76-41c6-b9dd-f5143d3cdd88 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:22.546004 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-9ff6783a-fd76-41c6-b9dd-f5143d3cdd88 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:22.552246 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9ff6783a-fd76-41c6-b9dd-f5143d3cdd88 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:22.552732 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9ff6783a-fd76-41c6-b9dd-f5143d3cdd88 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:22.553164 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9ff6783a-fd76-41c6-b9dd-f5143d3cdd88 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:22.554890 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9ff6783a-fd76-41c6-b9dd-f5143d3cdd88 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:22.555355 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9ff6783a-fd76-41c6-b9dd-f5143d3cdd88 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:22.555787 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9ff6783a-fd76-41c6-b9dd-f5143d3cdd88 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:22.760417 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-9ff6783a-fd76-41c6-b9dd-f5143d3cdd88 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:22.782559 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-9ff6783a-fd76-41c6-b9dd-f5143d3cdd88 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1322 microversion: 2.1 time: 0.242150 Aug 10 13:38:22.797422 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 56/83] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:22 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1322 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:22.934418 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-c8a9875f-7295-4724-b168-1b73356ee5f8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:22.935119 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-c8a9875f-7295-4724-b168-1b73356ee5f8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:22.943933 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c8a9875f-7295-4724-b168-1b73356ee5f8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:22.947790 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c8a9875f-7295-4724-b168-1b73356ee5f8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:22.948266 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c8a9875f-7295-4724-b168-1b73356ee5f8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:22.948992 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c8a9875f-7295-4724-b168-1b73356ee5f8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:22.951627 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c8a9875f-7295-4724-b168-1b73356ee5f8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:22.952075 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c8a9875f-7295-4724-b168-1b73356ee5f8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:22.961053 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-a55ea008-fc6e-48cf-9ea7-8a0e5bd3ba1b tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:22.962441 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-a55ea008-fc6e-48cf-9ea7-8a0e5bd3ba1b tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:22.974319 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a55ea008-fc6e-48cf-9ea7-8a0e5bd3ba1b tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:22.978835 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a55ea008-fc6e-48cf-9ea7-8a0e5bd3ba1b tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:22.980493 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a55ea008-fc6e-48cf-9ea7-8a0e5bd3ba1b tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:22.982802 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a55ea008-fc6e-48cf-9ea7-8a0e5bd3ba1b tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:22.984722 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a55ea008-fc6e-48cf-9ea7-8a0e5bd3ba1b tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:22.985950 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a55ea008-fc6e-48cf-9ea7-8a0e5bd3ba1b tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:23.306973 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-c8a9875f-7295-4724-b168-1b73356ee5f8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:23.318756 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-c8a9875f-7295-4724-b168-1b73356ee5f8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:23.320800 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-c8a9875f-7295-4724-b168-1b73356ee5f8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:23.322293 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-c8a9875f-7295-4724-b168-1b73356ee5f8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1408 microversion: 2.20 time: 0.394087 Aug 10 13:38:23.323506 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 28/84] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:38:22 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1408 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:38:23.331491 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-cdcabba7-071f-4208-82eb-07ee59c31192 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:23.332327 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-cdcabba7-071f-4208-82eb-07ee59c31192 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] [instance: a3e6b964-a4d5-4c24-8c8c-19373ddd2fff] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:23.339133 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cdcabba7-071f-4208-82eb-07ee59c31192 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:23.340109 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cdcabba7-071f-4208-82eb-07ee59c31192 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:23.340873 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cdcabba7-071f-4208-82eb-07ee59c31192 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:23.341806 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cdcabba7-071f-4208-82eb-07ee59c31192 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:23.342398 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cdcabba7-071f-4208-82eb-07ee59c31192 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:23.342961 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cdcabba7-071f-4208-82eb-07ee59c31192 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:23.373385 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-a55ea008-fc6e-48cf-9ea7-8a0e5bd3ba1b tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:23.388019 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-a55ea008-fc6e-48cf-9ea7-8a0e5bd3ba1b tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1360 microversion: 2.1 time: 0.431413 Aug 10 13:38:23.389378 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 57/85] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:22 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1360 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:23.521703 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-5018bbee-d2cf-41fa-a380-044befab9fcc tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:23.522843 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-5018bbee-d2cf-41fa-a380-044befab9fcc tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 41baab24-f648-4e7d-83bb-4357214ea438] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:23.535345 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5018bbee-d2cf-41fa-a380-044befab9fcc tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:23.541994 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5018bbee-d2cf-41fa-a380-044befab9fcc tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:23.542689 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5018bbee-d2cf-41fa-a380-044befab9fcc tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:23.545905 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5018bbee-d2cf-41fa-a380-044befab9fcc tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:23.547512 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5018bbee-d2cf-41fa-a380-044befab9fcc tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:23.548216 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5018bbee-d2cf-41fa-a380-044befab9fcc tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:24.024377 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-5018bbee-d2cf-41fa-a380-044befab9fcc tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:24.073216 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-5018bbee-d2cf-41fa-a380-044befab9fcc tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438" status: 200 len: 1368 microversion: 2.1 time: 0.556722 Aug 10 13:38:24.082358 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 58/86] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:23 2022] GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438 => generated 1368 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:24.093966 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-86ad8a2c-e5bc-4102-be8f-c3387dc94f6c req-ebaba1b5-532b-4478-af1a-e10980ff62ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdba9a34-3f3e-4314-a377-e6dc259c27cb", "name": "network-vif-plugged", "status": "completed", "tag": "3fd93ef8-553f-4b67-8470-c80fc47f7c94"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:38:24.122214 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-86ad8a2c-e5bc-4102-be8f-c3387dc94f6c req-ebaba1b5-532b-4478-af1a-e10980ff62ff service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:24.131904 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-86ad8a2c-e5bc-4102-be8f-c3387dc94f6c req-ebaba1b5-532b-4478-af1a-e10980ff62ff service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:24.139533 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-86ad8a2c-e5bc-4102-be8f-c3387dc94f6c req-ebaba1b5-532b-4478-af1a-e10980ff62ff service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:24.199424 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-86ad8a2c-e5bc-4102-be8f-c3387dc94f6c req-ebaba1b5-532b-4478-af1a-e10980ff62ff service nova] Creating event network-vif-plugged:3fd93ef8-553f-4b67-8470-c80fc47f7c94 for instance cdba9a34-3f3e-4314-a377-e6dc259c27cb on hv-cinder-85200 Aug 10 13:38:24.206842 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-86ad8a2c-e5bc-4102-be8f-c3387dc94f6c req-ebaba1b5-532b-4478-af1a-e10980ff62ff service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122970 Aug 10 13:38:24.207858 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 59/87] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:38:24.216072 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-fbf8a0ee-aa2f-4368-867f-ac562c0543fd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:24.217841 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-fbf8a0ee-aa2f-4368-867f-ac562c0543fd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:24.224800 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fbf8a0ee-aa2f-4368-867f-ac562c0543fd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:24.225544 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fbf8a0ee-aa2f-4368-867f-ac562c0543fd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:24.226220 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fbf8a0ee-aa2f-4368-867f-ac562c0543fd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:24.227261 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fbf8a0ee-aa2f-4368-867f-ac562c0543fd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:24.227923 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fbf8a0ee-aa2f-4368-867f-ac562c0543fd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:24.228586 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fbf8a0ee-aa2f-4368-867f-ac562c0543fd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:24.484345 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-cdcabba7-071f-4208-82eb-07ee59c31192 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258ccb4bb15a4747b4c17d2a26645888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c99d576d184b04b933db13eabb8c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:24.497851 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-cdcabba7-071f-4208-82eb-07ee59c31192 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] 10.222.0.52 "GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff" status: 200 len: 1314 microversion: 2.1 time: 1.172635 Aug 10 13:38:24.498960 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 29/88] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:23 2022] GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff => generated 1314 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:24.503806 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-b269b284-b195-470b-ad8e-1143f1aa47fb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:24.508251 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-b269b284-b195-470b-ad8e-1143f1aa47fb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:24.524381 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b269b284-b195-470b-ad8e-1143f1aa47fb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:24.526822 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b269b284-b195-470b-ad8e-1143f1aa47fb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:24.527572 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b269b284-b195-470b-ad8e-1143f1aa47fb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:24.528625 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b269b284-b195-470b-ad8e-1143f1aa47fb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:24.530525 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b269b284-b195-470b-ad8e-1143f1aa47fb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:24.531148 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b269b284-b195-470b-ad8e-1143f1aa47fb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:24.540424 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-fbf8a0ee-aa2f-4368-867f-ac562c0543fd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:24.548819 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-fbf8a0ee-aa2f-4368-867f-ac562c0543fd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1322 microversion: 2.1 time: 0.337097 Aug 10 13:38:24.549849 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 60/89] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:24 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1322 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:24.565033 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-d86409ab-ab9b-4a4f-b496-d2cbb3b5fc71 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:24.566832 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-d86409ab-ab9b-4a4f-b496-d2cbb3b5fc71 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:24.579493 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d86409ab-ab9b-4a4f-b496-d2cbb3b5fc71 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:24.586312 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d86409ab-ab9b-4a4f-b496-d2cbb3b5fc71 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:24.587666 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d86409ab-ab9b-4a4f-b496-d2cbb3b5fc71 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:24.588424 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d86409ab-ab9b-4a4f-b496-d2cbb3b5fc71 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:24.588892 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d86409ab-ab9b-4a4f-b496-d2cbb3b5fc71 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:24.589347 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d86409ab-ab9b-4a4f-b496-d2cbb3b5fc71 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:24.866352 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-d86409ab-ab9b-4a4f-b496-d2cbb3b5fc71 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:24.879973 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-d86409ab-ab9b-4a4f-b496-d2cbb3b5fc71 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1360 microversion: 2.1 time: 0.325274 Aug 10 13:38:24.880791 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 61/90] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:24 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1360 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:24.938800 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-b269b284-b195-470b-ad8e-1143f1aa47fb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:24.953158 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-b269b284-b195-470b-ad8e-1143f1aa47fb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:24.955977 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-b269b284-b195-470b-ad8e-1143f1aa47fb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:24.959218 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-b269b284-b195-470b-ad8e-1143f1aa47fb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1408 microversion: 2.20 time: 0.458295 Aug 10 13:38:24.975323 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 30/91] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:38:24 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1408 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:38:25.135333 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-04b40adf-3736-47ce-9474-52d423670168 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:25.136605 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-04b40adf-3736-47ce-9474-52d423670168 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 41baab24-f648-4e7d-83bb-4357214ea438] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:25.154816 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-04b40adf-3736-47ce-9474-52d423670168 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:25.159570 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-04b40adf-3736-47ce-9474-52d423670168 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:25.159987 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-04b40adf-3736-47ce-9474-52d423670168 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:25.161987 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-04b40adf-3736-47ce-9474-52d423670168 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:25.164236 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-04b40adf-3736-47ce-9474-52d423670168 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:25.164696 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-04b40adf-3736-47ce-9474-52d423670168 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:25.500621 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-04b40adf-3736-47ce-9474-52d423670168 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:25.513415 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-04b40adf-3736-47ce-9474-52d423670168 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438" status: 200 len: 1368 microversion: 2.1 time: 0.411373 Aug 10 13:38:25.515385 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 62/92] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:25 2022] GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438 => generated 1368 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:25.522265 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-0b7f1d83-cbb4-4b96-9b62-d3c5d8132341 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:25.522905 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-0b7f1d83-cbb4-4b96-9b62-d3c5d8132341 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] [instance: a3e6b964-a4d5-4c24-8c8c-19373ddd2fff] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:25.532967 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell0:SELECT=1 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:38:25.533859 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell0:SELECT=6 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:38:25.537798 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0b7f1d83-cbb4-4b96-9b62-d3c5d8132341 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:25.560790 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0b7f1d83-cbb4-4b96-9b62-d3c5d8132341 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:25.564667 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0b7f1d83-cbb4-4b96-9b62-d3c5d8132341 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:25.568038 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0b7f1d83-cbb4-4b96-9b62-d3c5d8132341 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:25.568529 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0b7f1d83-cbb4-4b96-9b62-d3c5d8132341 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:25.568964 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0b7f1d83-cbb4-4b96-9b62-d3c5d8132341 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:25.575291 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-78a6f766-8ad1-4acd-adb9-936ba134f4e1 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:25.576120 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-78a6f766-8ad1-4acd-adb9-936ba134f4e1 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:25.607249 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-78a6f766-8ad1-4acd-adb9-936ba134f4e1 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:25.607773 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-78a6f766-8ad1-4acd-adb9-936ba134f4e1 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:25.608329 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-78a6f766-8ad1-4acd-adb9-936ba134f4e1 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:25.609048 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-78a6f766-8ad1-4acd-adb9-936ba134f4e1 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:25.609533 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-78a6f766-8ad1-4acd-adb9-936ba134f4e1 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:25.609951 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-78a6f766-8ad1-4acd-adb9-936ba134f4e1 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:25.905010 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-78a6f766-8ad1-4acd-adb9-936ba134f4e1 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:25.927891 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-78a6f766-8ad1-4acd-adb9-936ba134f4e1 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1322 microversion: 2.1 time: 0.356863 Aug 10 13:38:25.942533 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 63/93] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:25 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1322 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:38:25.964447 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-6414c5d6-63fd-4c98-8fd7-4a2decb13fba tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:25.965890 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-6414c5d6-63fd-4c98-8fd7-4a2decb13fba tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:25.976658 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6414c5d6-63fd-4c98-8fd7-4a2decb13fba tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:25.978446 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6414c5d6-63fd-4c98-8fd7-4a2decb13fba tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:25.979334 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6414c5d6-63fd-4c98-8fd7-4a2decb13fba tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:25.980626 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6414c5d6-63fd-4c98-8fd7-4a2decb13fba tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:25.981354 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6414c5d6-63fd-4c98-8fd7-4a2decb13fba tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:25.982251 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6414c5d6-63fd-4c98-8fd7-4a2decb13fba tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:26.191516 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell0:SELECT=2 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:38:26.240928 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-6414c5d6-63fd-4c98-8fd7-4a2decb13fba tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:26.260045 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-6414c5d6-63fd-4c98-8fd7-4a2decb13fba tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1360 microversion: 2.1 time: 0.307926 Aug 10 13:38:26.261430 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 64/94] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:25 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1360 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:26.273637 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-f6f48768-85ae-4ffc-88aa-901f639d404c tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:26.281953 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-f6f48768-85ae-4ffc-88aa-901f639d404c tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:26.332948 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f6f48768-85ae-4ffc-88aa-901f639d404c tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:26.333828 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f6f48768-85ae-4ffc-88aa-901f639d404c tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:26.337784 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f6f48768-85ae-4ffc-88aa-901f639d404c tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:26.339816 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f6f48768-85ae-4ffc-88aa-901f639d404c tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:26.341834 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f6f48768-85ae-4ffc-88aa-901f639d404c tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:26.342420 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f6f48768-85ae-4ffc-88aa-901f639d404c tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:26.351341 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-0b7f1d83-cbb4-4b96-9b62-d3c5d8132341 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258ccb4bb15a4747b4c17d2a26645888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c99d576d184b04b933db13eabb8c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:26.369195 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-0b7f1d83-cbb4-4b96-9b62-d3c5d8132341 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] 10.222.0.52 "GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff" status: 200 len: 1499 microversion: 2.1 time: 0.844391 Aug 10 13:38:26.370537 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 31/95] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:25 2022] GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff => generated 1499 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:26.378829 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-c24cb4df-4ab1-4d71-94fb-d74935b87d9f req-4a63f980-56e3-4aef-9316-40ab79a5382a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "783660b7-d622-4df6-85cd-56c623cc835e", "name": "network-vif-plugged", "status": "completed", "tag": "10c04e92-bea1-4ea3-9a28-b5ad9e2d1d12"}, {"server_uuid": "9107fc16-6a2c-48ad-8612-964c3ac05c01", "name": "network-vif-plugged", "status": "completed", "tag": "ce8bc99b-8473-443a-affd-c91a70f09259"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:38:26.404667 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-c24cb4df-4ab1-4d71-94fb-d74935b87d9f req-4a63f980-56e3-4aef-9316-40ab79a5382a service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:26.407069 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-c24cb4df-4ab1-4d71-94fb-d74935b87d9f req-4a63f980-56e3-4aef-9316-40ab79a5382a service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:26.409153 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-c24cb4df-4ab1-4d71-94fb-d74935b87d9f req-4a63f980-56e3-4aef-9316-40ab79a5382a service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:26.421819 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell1:SELECT=100 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:38:26.446826 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-c24cb4df-4ab1-4d71-94fb-d74935b87d9f req-4a63f980-56e3-4aef-9316-40ab79a5382a service nova] Creating event network-vif-plugged:10c04e92-bea1-4ea3-9a28-b5ad9e2d1d12 for instance 783660b7-d622-4df6-85cd-56c623cc835e on hv-cinder-85200 Aug 10 13:38:26.448990 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-c24cb4df-4ab1-4d71-94fb-d74935b87d9f req-4a63f980-56e3-4aef-9316-40ab79a5382a service nova] Creating event network-vif-plugged:ce8bc99b-8473-443a-affd-c91a70f09259 for instance 9107fc16-6a2c-48ad-8612-964c3ac05c01 on hv-cinder-85200 Aug 10 13:38:26.465906 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-c24cb4df-4ab1-4d71-94fb-d74935b87d9f req-4a63f980-56e3-4aef-9316-40ab79a5382a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.093548 Aug 10 13:38:26.473454 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 32/96] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:38:26.535675 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-00b6485c-142f-47bd-8175-12c24f19d23f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:26.536388 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-00b6485c-142f-47bd-8175-12c24f19d23f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 41baab24-f648-4e7d-83bb-4357214ea438] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:26.547515 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-00b6485c-142f-47bd-8175-12c24f19d23f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:26.549819 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-00b6485c-142f-47bd-8175-12c24f19d23f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:26.550339 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-00b6485c-142f-47bd-8175-12c24f19d23f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:26.551670 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-00b6485c-142f-47bd-8175-12c24f19d23f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:26.552139 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-00b6485c-142f-47bd-8175-12c24f19d23f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:26.554630 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-00b6485c-142f-47bd-8175-12c24f19d23f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:26.838474 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-f6f48768-85ae-4ffc-88aa-901f639d404c tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:26.848378 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-f6f48768-85ae-4ffc-88aa-901f639d404c tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:26.852056 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-f6f48768-85ae-4ffc-88aa-901f639d404c tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:26.853641 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-f6f48768-85ae-4ffc-88aa-901f639d404c tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1408 microversion: 2.20 time: 0.590736 Aug 10 13:38:26.854362 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 65/97] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:38:26 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1408 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:38:26.958835 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-41035d8b-716c-44d6-aeb8-6388c3e12269 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:26.959611 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-41035d8b-716c-44d6-aeb8-6388c3e12269 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:26.986769 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-41035d8b-716c-44d6-aeb8-6388c3e12269 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:26.992171 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-41035d8b-716c-44d6-aeb8-6388c3e12269 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:26.992702 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-41035d8b-716c-44d6-aeb8-6388c3e12269 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:26.994596 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-41035d8b-716c-44d6-aeb8-6388c3e12269 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:26.995418 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-41035d8b-716c-44d6-aeb8-6388c3e12269 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:26.998472 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-41035d8b-716c-44d6-aeb8-6388c3e12269 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:27.137578 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-00b6485c-142f-47bd-8175-12c24f19d23f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:27.164669 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-00b6485c-142f-47bd-8175-12c24f19d23f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438" status: 200 len: 1559 microversion: 2.1 time: 0.630500 Aug 10 13:38:27.166449 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 33/98] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:26 2022] GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438 => generated 1559 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:27.190329 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-58e4db3a-5aff-44e7-adb5-e8c4717a95e7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:27.191106 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-58e4db3a-5aff-44e7-adb5-e8c4717a95e7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 41baab24-f648-4e7d-83bb-4357214ea438] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:27.206166 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-58e4db3a-5aff-44e7-adb5-e8c4717a95e7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:27.206899 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-58e4db3a-5aff-44e7-adb5-e8c4717a95e7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:27.208821 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-58e4db3a-5aff-44e7-adb5-e8c4717a95e7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:27.209767 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-58e4db3a-5aff-44e7-adb5-e8c4717a95e7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:27.210909 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-58e4db3a-5aff-44e7-adb5-e8c4717a95e7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:27.212985 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-58e4db3a-5aff-44e7-adb5-e8c4717a95e7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:27.365133 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-41035d8b-716c-44d6-aeb8-6388c3e12269 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:27.377117 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-41035d8b-716c-44d6-aeb8-6388c3e12269 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1322 microversion: 2.1 time: 0.422443 Aug 10 13:38:27.380513 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 66/99] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:26 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1322 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:38:27.391041 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-68837b0d-7665-4cfe-8f9a-3c1227a8ba47 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:27.393004 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-68837b0d-7665-4cfe-8f9a-3c1227a8ba47 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:27.408109 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-68837b0d-7665-4cfe-8f9a-3c1227a8ba47 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:27.410957 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-68837b0d-7665-4cfe-8f9a-3c1227a8ba47 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:27.411578 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-68837b0d-7665-4cfe-8f9a-3c1227a8ba47 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:27.413887 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-68837b0d-7665-4cfe-8f9a-3c1227a8ba47 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:27.417885 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-68837b0d-7665-4cfe-8f9a-3c1227a8ba47 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:27.418818 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-68837b0d-7665-4cfe-8f9a-3c1227a8ba47 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:27.442615 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-58e4db3a-5aff-44e7-adb5-e8c4717a95e7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.257210 Aug 10 13:38:27.445271 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 34/100] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Aug 10 13:38:27 2022] GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438/os-interface => generated 285 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:38:27.880238 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-bce62c50-93ba-4ff6-bd10-690571eb68e4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:27.881694 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-bce62c50-93ba-4ff6-bd10-690571eb68e4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:27.891849 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bce62c50-93ba-4ff6-bd10-690571eb68e4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:27.894914 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bce62c50-93ba-4ff6-bd10-690571eb68e4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:27.895951 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bce62c50-93ba-4ff6-bd10-690571eb68e4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:27.897042 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bce62c50-93ba-4ff6-bd10-690571eb68e4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:27.898761 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bce62c50-93ba-4ff6-bd10-690571eb68e4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:27.899481 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bce62c50-93ba-4ff6-bd10-690571eb68e4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:28.094493 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-68837b0d-7665-4cfe-8f9a-3c1227a8ba47 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:28.104002 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-68837b0d-7665-4cfe-8f9a-3c1227a8ba47 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1360 microversion: 2.1 time: 0.720280 Aug 10 13:38:28.104783 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 67/101] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:27 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1360 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:28.233628 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-975173b6-ec04-414d-9955-291f56637637 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18769102-084f-4734-bf7c-99ca4ae0df17"}} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:38:28.236475 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-975173b6-ec04-414d-9955-291f56637637 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] [instance: a3e6b964-a4d5-4c24-8c8c-19373ddd2fff] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:28.262388 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-975173b6-ec04-414d-9955-291f56637637 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:28.265087 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-975173b6-ec04-414d-9955-291f56637637 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:28.265718 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-975173b6-ec04-414d-9955-291f56637637 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:28.268213 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-975173b6-ec04-414d-9955-291f56637637 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:28.273378 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-975173b6-ec04-414d-9955-291f56637637 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:28.274005 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-975173b6-ec04-414d-9955-291f56637637 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:28.411671 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-bce62c50-93ba-4ff6-bd10-690571eb68e4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:28.423447 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-bce62c50-93ba-4ff6-bd10-690571eb68e4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:28.428698 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-bce62c50-93ba-4ff6-bd10-690571eb68e4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:28.432223 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-bce62c50-93ba-4ff6-bd10-690571eb68e4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1408 microversion: 2.20 time: 0.557051 Aug 10 13:38:28.432801 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 35/102] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:38:27 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1408 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:38:28.447821 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-a8c6290a-023d-40f9-b9a8-f5f3549f94a4 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:28.448907 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-a8c6290a-023d-40f9-b9a8-f5f3549f94a4 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:28.464538 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a8c6290a-023d-40f9-b9a8-f5f3549f94a4 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:28.465902 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a8c6290a-023d-40f9-b9a8-f5f3549f94a4 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:28.466995 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a8c6290a-023d-40f9-b9a8-f5f3549f94a4 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:28.467825 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a8c6290a-023d-40f9-b9a8-f5f3549f94a4 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:28.468283 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a8c6290a-023d-40f9-b9a8-f5f3549f94a4 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:28.468705 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a8c6290a-023d-40f9-b9a8-f5f3549f94a4 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:28.785569 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-a8c6290a-023d-40f9-b9a8-f5f3549f94a4 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:28.795051 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-a8c6290a-023d-40f9-b9a8-f5f3549f94a4 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1322 microversion: 2.1 time: 0.360242 Aug 10 13:38:28.808822 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 36/103] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:28 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1322 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:29.129837 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-e0dba3ef-e897-473c-a506-5989847fc622 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:29.130525 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-e0dba3ef-e897-473c-a506-5989847fc622 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:29.141153 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e0dba3ef-e897-473c-a506-5989847fc622 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:29.142631 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e0dba3ef-e897-473c-a506-5989847fc622 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:29.143838 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e0dba3ef-e897-473c-a506-5989847fc622 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:29.146391 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e0dba3ef-e897-473c-a506-5989847fc622 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:29.147072 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e0dba3ef-e897-473c-a506-5989847fc622 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:29.149343 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e0dba3ef-e897-473c-a506-5989847fc622 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:29.550550 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-e0dba3ef-e897-473c-a506-5989847fc622 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:29.564190 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-e0dba3ef-e897-473c-a506-5989847fc622 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1360 microversion: 2.1 time: 0.436563 Aug 10 13:38:29.565581 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 37/104] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:29 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1360 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:29.575640 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-57e267d1-8d4d-429a-8553-6e3a96f60c2e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:29.579372 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-57e267d1-8d4d-429a-8553-6e3a96f60c2e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:29.605151 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-57e267d1-8d4d-429a-8553-6e3a96f60c2e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:29.605970 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-57e267d1-8d4d-429a-8553-6e3a96f60c2e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:29.606664 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-57e267d1-8d4d-429a-8553-6e3a96f60c2e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:29.607665 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-57e267d1-8d4d-429a-8553-6e3a96f60c2e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:29.608335 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-57e267d1-8d4d-429a-8553-6e3a96f60c2e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:29.608945 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-57e267d1-8d4d-429a-8553-6e3a96f60c2e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:29.616373 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell1:SELECT=100 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:38:29.804799 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-57e267d1-8d4d-429a-8553-6e3a96f60c2e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:29.829724 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-57e267d1-8d4d-429a-8553-6e3a96f60c2e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:29.831619 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-57e267d1-8d4d-429a-8553-6e3a96f60c2e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:29.833174 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-57e267d1-8d4d-429a-8553-6e3a96f60c2e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1600 microversion: 2.20 time: 0.266645 Aug 10 13:38:29.834724 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 38/105] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:38:29 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1600 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:38:29.840503 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-79b2cf27-d6cb-4552-87a7-2db0a090f2f0 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:29.841722 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-79b2cf27-d6cb-4552-87a7-2db0a090f2f0 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:29.848057 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-79b2cf27-d6cb-4552-87a7-2db0a090f2f0 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:29.848729 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-79b2cf27-d6cb-4552-87a7-2db0a090f2f0 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:29.849346 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-79b2cf27-d6cb-4552-87a7-2db0a090f2f0 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:29.850186 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-79b2cf27-d6cb-4552-87a7-2db0a090f2f0 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:29.851026 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-79b2cf27-d6cb-4552-87a7-2db0a090f2f0 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:29.851598 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-79b2cf27-d6cb-4552-87a7-2db0a090f2f0 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:30.481583 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-79b2cf27-d6cb-4552-87a7-2db0a090f2f0 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:30.491994 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-79b2cf27-d6cb-4552-87a7-2db0a090f2f0 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1322 microversion: 2.1 time: 0.654335 Aug 10 13:38:30.496584 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 39/106] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:29 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1322 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:30.514640 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-7969a3b5-4c8e-4051-89b4-d93a07100f51 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:30.515149 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-7969a3b5-4c8e-4051-89b4-d93a07100f51 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:30.528310 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7969a3b5-4c8e-4051-89b4-d93a07100f51 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:30.528856 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7969a3b5-4c8e-4051-89b4-d93a07100f51 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:30.529494 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7969a3b5-4c8e-4051-89b4-d93a07100f51 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:30.530382 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7969a3b5-4c8e-4051-89b4-d93a07100f51 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:30.530991 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7969a3b5-4c8e-4051-89b4-d93a07100f51 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:30.531603 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7969a3b5-4c8e-4051-89b4-d93a07100f51 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:30.675437 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-7969a3b5-4c8e-4051-89b4-d93a07100f51 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.176565 Aug 10 13:38:30.676381 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 40/107] 10.222.0.52 () {60 vars in 1316 bytes} [Wed Aug 10 13:38:30 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb/os-interface => generated 285 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 13:38:30.681083 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-6b0a65bd-b34e-4cff-9e5a-504a82cefb34 req-e810a527-3136-42ed-aa0f-d384f3ad8c80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41baab24-f648-4e7d-83bb-4357214ea438", "tag": "094ff493-e302-4b0c-96d5-f742648c5682"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:38:30.701099 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-6b0a65bd-b34e-4cff-9e5a-504a82cefb34 req-e810a527-3136-42ed-aa0f-d384f3ad8c80 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:30.701957 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-6b0a65bd-b34e-4cff-9e5a-504a82cefb34 req-e810a527-3136-42ed-aa0f-d384f3ad8c80 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:30.703720 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-6b0a65bd-b34e-4cff-9e5a-504a82cefb34 req-e810a527-3136-42ed-aa0f-d384f3ad8c80 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:30.759196 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-6b0a65bd-b34e-4cff-9e5a-504a82cefb34 req-e810a527-3136-42ed-aa0f-d384f3ad8c80 service nova] Creating event network-changed:094ff493-e302-4b0c-96d5-f742648c5682 for instance 41baab24-f648-4e7d-83bb-4357214ea438 on hv-cinder-85200 Aug 10 13:38:30.771031 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-6b0a65bd-b34e-4cff-9e5a-504a82cefb34 req-e810a527-3136-42ed-aa0f-d384f3ad8c80 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093254 Aug 10 13:38:30.773872 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 41/108] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:38:30.785088 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-07721ac6-0d64-48c4-b93f-2500be69d561 req-727a72a4-b934-45f5-b7be-22f5a57593b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "589498ff-2901-49e5-91c2-0275f4dcf522", "name": "network-vif-plugged", "status": "completed", "tag": "55a42d5a-6bbe-4f41-9140-ed498c4f571f"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:38:30.808824 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-07721ac6-0d64-48c4-b93f-2500be69d561 req-727a72a4-b934-45f5-b7be-22f5a57593b8 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:30.810113 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-07721ac6-0d64-48c4-b93f-2500be69d561 req-727a72a4-b934-45f5-b7be-22f5a57593b8 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:30.813070 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-07721ac6-0d64-48c4-b93f-2500be69d561 req-727a72a4-b934-45f5-b7be-22f5a57593b8 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:30.843568 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-07721ac6-0d64-48c4-b93f-2500be69d561 req-727a72a4-b934-45f5-b7be-22f5a57593b8 service nova] Creating event network-vif-plugged:55a42d5a-6bbe-4f41-9140-ed498c4f571f for instance 589498ff-2901-49e5-91c2-0275f4dcf522 on hv-cinder-85200 Aug 10 13:38:30.860636 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-07721ac6-0d64-48c4-b93f-2500be69d561 req-727a72a4-b934-45f5-b7be-22f5a57593b8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083569 Aug 10 13:38:30.861578 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 42/109] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:38:30.878017 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-4b0a27a7-8e3c-4989-9d89-a22db8c1af50 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:30.879884 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-4b0a27a7-8e3c-4989-9d89-a22db8c1af50 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:30.887161 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4b0a27a7-8e3c-4989-9d89-a22db8c1af50 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:30.888391 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4b0a27a7-8e3c-4989-9d89-a22db8c1af50 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:30.889864 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4b0a27a7-8e3c-4989-9d89-a22db8c1af50 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:30.890991 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4b0a27a7-8e3c-4989-9d89-a22db8c1af50 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:30.891636 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4b0a27a7-8e3c-4989-9d89-a22db8c1af50 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:30.892205 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4b0a27a7-8e3c-4989-9d89-a22db8c1af50 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:31.040920 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-975173b6-ec04-414d-9955-291f56637637 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] 10.222.0.52 "POST /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.825590 Aug 10 13:38:31.042468 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 68/110] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 10 13:38:28 2022] POST /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff/os-volume_attachments => generated 194 bytes in 2828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:38:31.520667 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-e9470999-364c-47c8-bb02-5d70ac0dd6ef tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:31.521718 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-e9470999-364c-47c8-bb02-5d70ac0dd6ef tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:31.536266 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e9470999-364c-47c8-bb02-5d70ac0dd6ef tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:31.538059 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e9470999-364c-47c8-bb02-5d70ac0dd6ef tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:31.538776 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e9470999-364c-47c8-bb02-5d70ac0dd6ef tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:31.541221 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e9470999-364c-47c8-bb02-5d70ac0dd6ef tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:31.544262 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e9470999-364c-47c8-bb02-5d70ac0dd6ef tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:31.544965 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e9470999-364c-47c8-bb02-5d70ac0dd6ef tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:31.582147 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-4b0a27a7-8e3c-4989-9d89-a22db8c1af50 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:31.591163 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-4b0a27a7-8e3c-4989-9d89-a22db8c1af50 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1360 microversion: 2.1 time: 0.727509 Aug 10 13:38:31.595630 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 43/111] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:30 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1360 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:31.971376 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-e9470999-364c-47c8-bb02-5d70ac0dd6ef tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:31.980462 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-e9470999-364c-47c8-bb02-5d70ac0dd6ef tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1516 microversion: 2.1 time: 0.466155 Aug 10 13:38:31.981142 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 69/112] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:31 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1516 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:32.010754 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-47186cc6-2100-4814-b909-7f54fddf1745 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:38:32.013044 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-47186cc6-2100-4814-b909-7f54fddf1745 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:32.024981 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-47186cc6-2100-4814-b909-7f54fddf1745 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:32.027825 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-47186cc6-2100-4814-b909-7f54fddf1745 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:32.031579 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-47186cc6-2100-4814-b909-7f54fddf1745 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:32.032636 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-47186cc6-2100-4814-b909-7f54fddf1745 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:32.033177 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-47186cc6-2100-4814-b909-7f54fddf1745 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:32.033715 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-47186cc6-2100-4814-b909-7f54fddf1745 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:32.059756 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.objects.instance [None req-47186cc6-2100-4814-b909-7f54fddf1745 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lazy-loading 'flavor' on Instance uuid 783660b7-d622-4df6-85cd-56c623cc835e {{(pid=129523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:38:32.298185 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-47186cc6-2100-4814-b909-7f54fddf1745 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "POST /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e/action" status: 200 len: 32 microversion: 2.1 time: 0.295073 Aug 10 13:38:32.305616 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 44/113] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 10 13:38:32 2022] POST /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e/action => generated 32 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 13:38:32.317690 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-c003320a-a16a-4755-aaff-e2cc8b040d85 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:32.320578 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-c003320a-a16a-4755-aaff-e2cc8b040d85 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:32.342521 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c003320a-a16a-4755-aaff-e2cc8b040d85 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:32.344156 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c003320a-a16a-4755-aaff-e2cc8b040d85 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:32.344640 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c003320a-a16a-4755-aaff-e2cc8b040d85 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:32.345458 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c003320a-a16a-4755-aaff-e2cc8b040d85 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:32.348589 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c003320a-a16a-4755-aaff-e2cc8b040d85 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:32.350159 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c003320a-a16a-4755-aaff-e2cc8b040d85 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:32.620427 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-6da114ed-08f4-45e7-9541-2b2a183261f9 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:32.621389 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-6da114ed-08f4-45e7-9541-2b2a183261f9 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:32.644334 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6da114ed-08f4-45e7-9541-2b2a183261f9 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:32.644839 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6da114ed-08f4-45e7-9541-2b2a183261f9 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:32.645311 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6da114ed-08f4-45e7-9541-2b2a183261f9 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:32.646031 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6da114ed-08f4-45e7-9541-2b2a183261f9 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:32.646489 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6da114ed-08f4-45e7-9541-2b2a183261f9 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:32.650768 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6da114ed-08f4-45e7-9541-2b2a183261f9 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:32.728033 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-c003320a-a16a-4755-aaff-e2cc8b040d85 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:32.738940 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-c003320a-a16a-4755-aaff-e2cc8b040d85 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1522 microversion: 2.1 time: 0.432936 Aug 10 13:38:32.743263 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 70/114] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:32 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1522 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:33.013677 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-6da114ed-08f4-45e7-9541-2b2a183261f9 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:33.027063 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-6da114ed-08f4-45e7-9541-2b2a183261f9 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1360 microversion: 2.1 time: 0.411448 Aug 10 13:38:33.028242 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 45/115] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:32 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1360 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:33.078861 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-2b60935a-6fe1-4431-8259-b97812fdd921 req-2d036e9c-b6bc-452a-ba6f-3f1170a455c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdba9a34-3f3e-4314-a377-e6dc259c27cb", "tag": "3fd93ef8-553f-4b67-8470-c80fc47f7c94"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:38:33.098365 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-2b60935a-6fe1-4431-8259-b97812fdd921 req-2d036e9c-b6bc-452a-ba6f-3f1170a455c4 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:33.099099 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-2b60935a-6fe1-4431-8259-b97812fdd921 req-2d036e9c-b6bc-452a-ba6f-3f1170a455c4 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:33.099694 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-2b60935a-6fe1-4431-8259-b97812fdd921 req-2d036e9c-b6bc-452a-ba6f-3f1170a455c4 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:33.115085 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-2b60935a-6fe1-4431-8259-b97812fdd921 req-2d036e9c-b6bc-452a-ba6f-3f1170a455c4 service nova] Creating event network-changed:3fd93ef8-553f-4b67-8470-c80fc47f7c94 for instance cdba9a34-3f3e-4314-a377-e6dc259c27cb on hv-cinder-85200 Aug 10 13:38:33.120804 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-2b60935a-6fe1-4431-8259-b97812fdd921 req-2d036e9c-b6bc-452a-ba6f-3f1170a455c4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045685 Aug 10 13:38:33.125392 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 71/116] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:38:33.765264 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-d4acd4b0-0194-4cb2-bfb2-6ef9c380e58f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:33.768534 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-d4acd4b0-0194-4cb2-bfb2-6ef9c380e58f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:33.781130 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d4acd4b0-0194-4cb2-bfb2-6ef9c380e58f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:33.786330 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d4acd4b0-0194-4cb2-bfb2-6ef9c380e58f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:33.786968 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d4acd4b0-0194-4cb2-bfb2-6ef9c380e58f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:33.787742 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d4acd4b0-0194-4cb2-bfb2-6ef9c380e58f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:33.792857 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d4acd4b0-0194-4cb2-bfb2-6ef9c380e58f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:33.799528 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d4acd4b0-0194-4cb2-bfb2-6ef9c380e58f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:34.051712 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-11aa745b-2307-4956-b376-c2e86ef62cdc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:34.053301 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-11aa745b-2307-4956-b376-c2e86ef62cdc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:34.060617 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-11aa745b-2307-4956-b376-c2e86ef62cdc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:34.061486 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-11aa745b-2307-4956-b376-c2e86ef62cdc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:34.062165 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-11aa745b-2307-4956-b376-c2e86ef62cdc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:34.063347 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-11aa745b-2307-4956-b376-c2e86ef62cdc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:34.064006 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-11aa745b-2307-4956-b376-c2e86ef62cdc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:34.064636 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-11aa745b-2307-4956-b376-c2e86ef62cdc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:34.405920 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-11aa745b-2307-4956-b376-c2e86ef62cdc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:34.415439 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-11aa745b-2307-4956-b376-c2e86ef62cdc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1360 microversion: 2.1 time: 0.368580 Aug 10 13:38:34.433903 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 72/117] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:34 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1360 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:34.582208 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-d4acd4b0-0194-4cb2-bfb2-6ef9c380e58f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:34.614666 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-d4acd4b0-0194-4cb2-bfb2-6ef9c380e58f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1522 microversion: 2.1 time: 0.855495 Aug 10 13:38:34.615796 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 46/118] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:33 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1522 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:35.441262 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-4e3607f5-32fe-4e86-918e-dfd0837ea541 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:35.442022 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-4e3607f5-32fe-4e86-918e-dfd0837ea541 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:35.453289 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4e3607f5-32fe-4e86-918e-dfd0837ea541 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:35.454865 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4e3607f5-32fe-4e86-918e-dfd0837ea541 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:35.456741 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4e3607f5-32fe-4e86-918e-dfd0837ea541 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:35.458393 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4e3607f5-32fe-4e86-918e-dfd0837ea541 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:35.460873 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4e3607f5-32fe-4e86-918e-dfd0837ea541 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:35.461478 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4e3607f5-32fe-4e86-918e-dfd0837ea541 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:35.637110 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-44682a67-2135-46fe-9f36-a7f490c0d1f2 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:35.638412 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-44682a67-2135-46fe-9f36-a7f490c0d1f2 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:35.655336 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-44682a67-2135-46fe-9f36-a7f490c0d1f2 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:35.658061 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-44682a67-2135-46fe-9f36-a7f490c0d1f2 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:35.658762 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-44682a67-2135-46fe-9f36-a7f490c0d1f2 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:35.660016 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-44682a67-2135-46fe-9f36-a7f490c0d1f2 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:35.663253 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-44682a67-2135-46fe-9f36-a7f490c0d1f2 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:35.667139 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-44682a67-2135-46fe-9f36-a7f490c0d1f2 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:35.813592 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-4e3607f5-32fe-4e86-918e-dfd0837ea541 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:35.821849 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-4e3607f5-32fe-4e86-918e-dfd0837ea541 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1360 microversion: 2.1 time: 0.386497 Aug 10 13:38:35.822445 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 73/119] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:35 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1360 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:36.398848 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-44682a67-2135-46fe-9f36-a7f490c0d1f2 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:36.407876 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-44682a67-2135-46fe-9f36-a7f490c0d1f2 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1522 microversion: 2.1 time: 0.775829 Aug 10 13:38:36.422381 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 47/120] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:35 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1522 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:36.843272 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-5bf626d5-17df-4fc2-9743-cecf49557770 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:36.843888 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-5bf626d5-17df-4fc2-9743-cecf49557770 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:36.850453 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5bf626d5-17df-4fc2-9743-cecf49557770 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:36.850933 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5bf626d5-17df-4fc2-9743-cecf49557770 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:36.851365 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5bf626d5-17df-4fc2-9743-cecf49557770 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:36.852053 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5bf626d5-17df-4fc2-9743-cecf49557770 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:36.852504 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5bf626d5-17df-4fc2-9743-cecf49557770 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:36.852919 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5bf626d5-17df-4fc2-9743-cecf49557770 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:36.982833 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-5bf626d5-17df-4fc2-9743-cecf49557770 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:36.990753 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-5bf626d5-17df-4fc2-9743-cecf49557770 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1545 microversion: 2.1 time: 0.151322 Aug 10 13:38:36.991921 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 74/121] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:36 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1545 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:37.015607 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-293f580a-3de6-4274-a00b-33ac768510ff tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:37.015607 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-293f580a-3de6-4274-a00b-33ac768510ff tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:37.019901 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-293f580a-3de6-4274-a00b-33ac768510ff tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:37.020386 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-293f580a-3de6-4274-a00b-33ac768510ff tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:37.020817 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-293f580a-3de6-4274-a00b-33ac768510ff tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:37.021578 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-293f580a-3de6-4274-a00b-33ac768510ff tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:37.022604 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-293f580a-3de6-4274-a00b-33ac768510ff tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:37.023097 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-293f580a-3de6-4274-a00b-33ac768510ff tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:37.235558 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-293f580a-3de6-4274-a00b-33ac768510ff tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.226936 Aug 10 13:38:37.236153 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 48/122] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Aug 10 13:38:37 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522/os-interface => generated 284 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:38:37.434621 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-f559533e-2c4a-4a83-aa49-5b8839c38265 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:37.435252 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-f559533e-2c4a-4a83-aa49-5b8839c38265 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:37.443502 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f559533e-2c4a-4a83-aa49-5b8839c38265 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:37.444762 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f559533e-2c4a-4a83-aa49-5b8839c38265 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:37.446259 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f559533e-2c4a-4a83-aa49-5b8839c38265 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:37.447848 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f559533e-2c4a-4a83-aa49-5b8839c38265 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:37.449241 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f559533e-2c4a-4a83-aa49-5b8839c38265 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:37.450238 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f559533e-2c4a-4a83-aa49-5b8839c38265 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:37.572645 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-066069b0-025b-453d-817d-639084e456a0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Action: 'create', calling method: .version_select at 0x7f49c48c9a60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1990044180", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGBFpbVOAX5xesDX5vnPN5r3DCo3eD5iGwumOKXu1q7zd2j8JmgXQMs8ljwuTNvEDUqA9A2jkYMUKhM35pi5PMftbudpAjVPVAnh8oZqFgJKysszFLkrD38D3qeYnd+9Q=="}} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:38:37.586386 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_api:SELECT=100 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:38:37.593312 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.quota [None req-066069b0-025b-453d-817d-639084e456a0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Getting quotas for project b52f008781f64d09b706d478c8fe8922. Resources: {'key_pairs'} {{(pid=129522) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:38:37.601446 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.quota [None req-066069b0-025b-453d-817d-639084e456a0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Getting quotas for user 411ff3f0306848ee91108343982806ca and project b52f008781f64d09b706d478c8fe8922. Resources: {'key_pairs'} {{(pid=129522) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:38:37.630971 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-066069b0-025b-453d-817d-639084e456a0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.451189 Aug 10 13:38:37.632233 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 75/123] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Aug 10 13:38:37 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:38:37.673542 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-f559533e-2c4a-4a83-aa49-5b8839c38265 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:37.682261 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-f559533e-2c4a-4a83-aa49-5b8839c38265 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1522 microversion: 2.1 time: 0.252212 Aug 10 13:38:37.684759 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 49/124] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:37 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:38:38.704254 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-87854836-6623-4525-8c5c-17519a211770 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:38.704880 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-87854836-6623-4525-8c5c-17519a211770 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:38.715891 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-87854836-6623-4525-8c5c-17519a211770 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:38.716384 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-87854836-6623-4525-8c5c-17519a211770 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:38.718595 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-87854836-6623-4525-8c5c-17519a211770 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:38.719548 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-87854836-6623-4525-8c5c-17519a211770 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:38.720265 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-87854836-6623-4525-8c5c-17519a211770 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:38.722895 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-87854836-6623-4525-8c5c-17519a211770 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:39.002934 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-87854836-6623-4525-8c5c-17519a211770 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:39.011774 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-87854836-6623-4525-8c5c-17519a211770 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1522 microversion: 2.1 time: 0.312482 Aug 10 13:38:39.012344 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 76/125] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:38 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:39.376652 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-744a65dd-8f80-4f11-8d90-b94dc191dd26 req-ef372660-987e-4b26-9c49-1436c00a5f82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "589498ff-2901-49e5-91c2-0275f4dcf522", "tag": "55a42d5a-6bbe-4f41-9140-ed498c4f571f"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:38:39.397141 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-744a65dd-8f80-4f11-8d90-b94dc191dd26 req-ef372660-987e-4b26-9c49-1436c00a5f82 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:39.397677 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-744a65dd-8f80-4f11-8d90-b94dc191dd26 req-ef372660-987e-4b26-9c49-1436c00a5f82 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:39.400148 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-744a65dd-8f80-4f11-8d90-b94dc191dd26 req-ef372660-987e-4b26-9c49-1436c00a5f82 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:39.431637 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-744a65dd-8f80-4f11-8d90-b94dc191dd26 req-ef372660-987e-4b26-9c49-1436c00a5f82 service nova] Creating event network-changed:55a42d5a-6bbe-4f41-9140-ed498c4f571f for instance 589498ff-2901-49e5-91c2-0275f4dcf522 on hv-cinder-85200 Aug 10 13:38:39.446464 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-744a65dd-8f80-4f11-8d90-b94dc191dd26 req-ef372660-987e-4b26-9c49-1436c00a5f82 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071592 Aug 10 13:38:39.450439 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 50/126] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:38:40.036896 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-d395307f-7803-4538-b74e-41d7388b3f75 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:40.038773 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-d395307f-7803-4538-b74e-41d7388b3f75 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:40.072662 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d395307f-7803-4538-b74e-41d7388b3f75 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:40.075146 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d395307f-7803-4538-b74e-41d7388b3f75 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:40.077450 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d395307f-7803-4538-b74e-41d7388b3f75 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:40.081194 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d395307f-7803-4538-b74e-41d7388b3f75 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:40.083498 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d395307f-7803-4538-b74e-41d7388b3f75 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:40.086639 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d395307f-7803-4538-b74e-41d7388b3f75 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:40.535250 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-d395307f-7803-4538-b74e-41d7388b3f75 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:40.547226 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-d395307f-7803-4538-b74e-41d7388b3f75 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1522 microversion: 2.1 time: 0.518982 Aug 10 13:38:40.548710 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 77/127] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:40 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1522 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:41.574241 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-2b4ea972-4417-4c99-a957-6d744280a4fc tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:41.574241 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-2b4ea972-4417-4c99-a957-6d744280a4fc tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:41.579556 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2b4ea972-4417-4c99-a957-6d744280a4fc tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:41.580051 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2b4ea972-4417-4c99-a957-6d744280a4fc tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:41.580564 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2b4ea972-4417-4c99-a957-6d744280a4fc tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:41.581272 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2b4ea972-4417-4c99-a957-6d744280a4fc tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:41.581726 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2b4ea972-4417-4c99-a957-6d744280a4fc tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:41.582638 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2b4ea972-4417-4c99-a957-6d744280a4fc tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:41.795883 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-2b4ea972-4417-4c99-a957-6d744280a4fc tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:41.807352 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-2b4ea972-4417-4c99-a957-6d744280a4fc tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1522 microversion: 2.1 time: 0.240461 Aug 10 13:38:41.807948 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 51/128] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:41 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:42.834533 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-ac1ba1dd-720b-4f90-b6df-12a08c543fb0 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:42.835742 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-ac1ba1dd-720b-4f90-b6df-12a08c543fb0 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:42.843053 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ac1ba1dd-720b-4f90-b6df-12a08c543fb0 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:42.843919 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ac1ba1dd-720b-4f90-b6df-12a08c543fb0 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:42.844523 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ac1ba1dd-720b-4f90-b6df-12a08c543fb0 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:42.845305 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ac1ba1dd-720b-4f90-b6df-12a08c543fb0 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:42.845810 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ac1ba1dd-720b-4f90-b6df-12a08c543fb0 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:42.846226 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ac1ba1dd-720b-4f90-b6df-12a08c543fb0 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:43.000506 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-ac1ba1dd-720b-4f90-b6df-12a08c543fb0 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:43.010307 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-ac1ba1dd-720b-4f90-b6df-12a08c543fb0 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1522 microversion: 2.1 time: 0.182288 Aug 10 13:38:43.010892 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 78/129] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:42 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:43.304915 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-8055d21c-3533-49be-a125-a34e9ad3a152 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:43.305566 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-8055d21c-3533-49be-a125-a34e9ad3a152 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] [instance: a3e6b964-a4d5-4c24-8c8c-19373ddd2fff] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:43.311594 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8055d21c-3533-49be-a125-a34e9ad3a152 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:43.312271 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8055d21c-3533-49be-a125-a34e9ad3a152 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:43.312949 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8055d21c-3533-49be-a125-a34e9ad3a152 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:43.313872 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8055d21c-3533-49be-a125-a34e9ad3a152 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:43.314480 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8055d21c-3533-49be-a125-a34e9ad3a152 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:43.315058 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8055d21c-3533-49be-a125-a34e9ad3a152 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:43.343946 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-8055d21c-3533-49be-a125-a34e9ad3a152 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] [instance: a3e6b964-a4d5-4c24-8c8c-19373ddd2fff] Going to try to terminate instance {{(pid=129523) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:38:43.457621 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-8055d21c-3533-49be-a125-a34e9ad3a152 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff" status: 204 len: 0 microversion: 2.1 time: 0.156662 Aug 10 13:38:43.458567 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 52/130] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 10 13:38:43 2022] DELETE /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:38:43.467590 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-df066a86-e463-495b-b3b8-c523ddb57ed6 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:43.468213 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-df066a86-e463-495b-b3b8-c523ddb57ed6 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] [instance: a3e6b964-a4d5-4c24-8c8c-19373ddd2fff] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:43.475888 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-df066a86-e463-495b-b3b8-c523ddb57ed6 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:43.476594 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-df066a86-e463-495b-b3b8-c523ddb57ed6 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:43.477041 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-df066a86-e463-495b-b3b8-c523ddb57ed6 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:43.477776 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-df066a86-e463-495b-b3b8-c523ddb57ed6 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:43.478261 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-df066a86-e463-495b-b3b8-c523ddb57ed6 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:43.478733 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-df066a86-e463-495b-b3b8-c523ddb57ed6 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:43.622748 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-df066a86-e463-495b-b3b8-c523ddb57ed6 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258ccb4bb15a4747b4c17d2a26645888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c99d576d184b04b933db13eabb8c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:43.631488 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-df066a86-e463-495b-b3b8-c523ddb57ed6 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] 10.222.0.52 "GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff" status: 200 len: 1551 microversion: 2.1 time: 0.168052 Aug 10 13:38:43.632566 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 79/131] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:43 2022] GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff => generated 1551 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:38:44.032181 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-9f2f1e7d-b6df-49d5-a280-ec2d7634f1c2 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:44.033175 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-9f2f1e7d-b6df-49d5-a280-ec2d7634f1c2 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:44.043742 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9f2f1e7d-b6df-49d5-a280-ec2d7634f1c2 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:44.044916 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9f2f1e7d-b6df-49d5-a280-ec2d7634f1c2 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:44.045912 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9f2f1e7d-b6df-49d5-a280-ec2d7634f1c2 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:44.046841 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9f2f1e7d-b6df-49d5-a280-ec2d7634f1c2 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:44.047499 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9f2f1e7d-b6df-49d5-a280-ec2d7634f1c2 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:44.048137 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9f2f1e7d-b6df-49d5-a280-ec2d7634f1c2 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:44.238519 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-9f2f1e7d-b6df-49d5-a280-ec2d7634f1c2 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:44.242603 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:38:44.253119 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-9f2f1e7d-b6df-49d5-a280-ec2d7634f1c2 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1522 microversion: 2.1 time: 0.224841 Aug 10 13:38:44.270837 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 53/132] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:44 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:44.654239 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-434c8f94-39de-419b-ba30-575846833cad tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:44.654961 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-434c8f94-39de-419b-ba30-575846833cad tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] [instance: a3e6b964-a4d5-4c24-8c8c-19373ddd2fff] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:44.662210 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-434c8f94-39de-419b-ba30-575846833cad tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:44.662692 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-434c8f94-39de-419b-ba30-575846833cad tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:44.663142 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-434c8f94-39de-419b-ba30-575846833cad tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:44.663823 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-434c8f94-39de-419b-ba30-575846833cad tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:44.664273 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-434c8f94-39de-419b-ba30-575846833cad tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:44.664725 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-434c8f94-39de-419b-ba30-575846833cad tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:44.791640 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-434c8f94-39de-419b-ba30-575846833cad tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258ccb4bb15a4747b4c17d2a26645888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c99d576d184b04b933db13eabb8c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:44.799558 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-434c8f94-39de-419b-ba30-575846833cad tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] 10.222.0.52 "GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff" status: 200 len: 1551 microversion: 2.1 time: 0.149648 Aug 10 13:38:44.800135 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 80/133] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:44 2022] GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff => generated 1551 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:45.278643 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-fb3e81e8-77bf-4522-83f1-4ef8e308d73d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:45.279261 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-fb3e81e8-77bf-4522-83f1-4ef8e308d73d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:45.281252 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:38:45.291788 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-fb3e81e8-77bf-4522-83f1-4ef8e308d73d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:45.292676 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-fb3e81e8-77bf-4522-83f1-4ef8e308d73d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:45.293459 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-fb3e81e8-77bf-4522-83f1-4ef8e308d73d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:45.294523 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-fb3e81e8-77bf-4522-83f1-4ef8e308d73d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:45.294983 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-fb3e81e8-77bf-4522-83f1-4ef8e308d73d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:45.295414 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-fb3e81e8-77bf-4522-83f1-4ef8e308d73d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:45.447536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-fb3e81e8-77bf-4522-83f1-4ef8e308d73d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:45.455509 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-fb3e81e8-77bf-4522-83f1-4ef8e308d73d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1522 microversion: 2.1 time: 0.181484 Aug 10 13:38:45.456227 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 54/134] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:45 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:45.822222 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-ce08f9dd-8893-41d3-9e2d-19bbf79c5cbb tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:45.822222 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-ce08f9dd-8893-41d3-9e2d-19bbf79c5cbb tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] [instance: a3e6b964-a4d5-4c24-8c8c-19373ddd2fff] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:45.828280 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ce08f9dd-8893-41d3-9e2d-19bbf79c5cbb tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:45.828839 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ce08f9dd-8893-41d3-9e2d-19bbf79c5cbb tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:45.829371 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ce08f9dd-8893-41d3-9e2d-19bbf79c5cbb tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:45.830146 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ce08f9dd-8893-41d3-9e2d-19bbf79c5cbb tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:45.831034 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ce08f9dd-8893-41d3-9e2d-19bbf79c5cbb tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:45.831471 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ce08f9dd-8893-41d3-9e2d-19bbf79c5cbb tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:45.974715 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-ce08f9dd-8893-41d3-9e2d-19bbf79c5cbb tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258ccb4bb15a4747b4c17d2a26645888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c99d576d184b04b933db13eabb8c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:45.983421 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-ce08f9dd-8893-41d3-9e2d-19bbf79c5cbb tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] 10.222.0.52 "GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff" status: 200 len: 1551 microversion: 2.1 time: 0.166745 Aug 10 13:38:45.983983 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 81/135] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:45 2022] GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff => generated 1551 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:46.477899 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-ede1a32a-ba49-492d-9ef3-2941f9098c45 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:46.478684 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-ede1a32a-ba49-492d-9ef3-2941f9098c45 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:46.485034 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ede1a32a-ba49-492d-9ef3-2941f9098c45 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:46.485488 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ede1a32a-ba49-492d-9ef3-2941f9098c45 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:46.485918 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ede1a32a-ba49-492d-9ef3-2941f9098c45 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:46.486609 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ede1a32a-ba49-492d-9ef3-2941f9098c45 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:46.487055 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ede1a32a-ba49-492d-9ef3-2941f9098c45 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:46.487747 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ede1a32a-ba49-492d-9ef3-2941f9098c45 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:46.720348 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-ede1a32a-ba49-492d-9ef3-2941f9098c45 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:46.728652 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-ede1a32a-ba49-492d-9ef3-2941f9098c45 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1522 microversion: 2.1 time: 0.255482 Aug 10 13:38:46.729251 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 55/136] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:46 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:47.010163 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-5d4210a7-d0ac-4cdb-a83d-d78df6f7c7e6 req-0a645a12-d22a-4924-9e22-bbf27bbd8920 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3e6b964-a4d5-4c24-8c8c-19373ddd2fff", "name": "network-vif-deleted", "tag": "c8823e05-42fa-4833-b852-78973a85cd31"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:38:47.014240 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-c37c092f-2f74-4cfd-8874-3f5081b3ab2c tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:47.014689 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-c37c092f-2f74-4cfd-8874-3f5081b3ab2c tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] [instance: a3e6b964-a4d5-4c24-8c8c-19373ddd2fff] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:47.031551 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c37c092f-2f74-4cfd-8874-3f5081b3ab2c tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:47.032602 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c37c092f-2f74-4cfd-8874-3f5081b3ab2c tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:47.033425 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c37c092f-2f74-4cfd-8874-3f5081b3ab2c tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:47.034586 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c37c092f-2f74-4cfd-8874-3f5081b3ab2c tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:47.035112 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c37c092f-2f74-4cfd-8874-3f5081b3ab2c tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:47.035787 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c37c092f-2f74-4cfd-8874-3f5081b3ab2c tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:47.037583 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-5d4210a7-d0ac-4cdb-a83d-d78df6f7c7e6 req-0a645a12-d22a-4924-9e22-bbf27bbd8920 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:47.038509 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-5d4210a7-d0ac-4cdb-a83d-d78df6f7c7e6 req-0a645a12-d22a-4924-9e22-bbf27bbd8920 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:47.045134 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-5d4210a7-d0ac-4cdb-a83d-d78df6f7c7e6 req-0a645a12-d22a-4924-9e22-bbf27bbd8920 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:47.068072 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:38:47.068230 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-5d4210a7-d0ac-4cdb-a83d-d78df6f7c7e6 req-0a645a12-d22a-4924-9e22-bbf27bbd8920 service nova] Creating event network-vif-deleted:c8823e05-42fa-4833-b852-78973a85cd31 for instance a3e6b964-a4d5-4c24-8c8c-19373ddd2fff on hv-cinder-85200 Aug 10 13:38:47.077343 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-5d4210a7-d0ac-4cdb-a83d-d78df6f7c7e6 req-0a645a12-d22a-4924-9e22-bbf27bbd8920 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071408 Aug 10 13:38:47.081715 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 56/137] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:38:47.146932 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-c37c092f-2f74-4cfd-8874-3f5081b3ab2c tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258ccb4bb15a4747b4c17d2a26645888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c99d576d184b04b933db13eabb8c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:47.155500 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-c37c092f-2f74-4cfd-8874-3f5081b3ab2c tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] 10.222.0.52 "GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff" status: 200 len: 1509 microversion: 2.1 time: 0.154821 Aug 10 13:38:47.156081 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 82/138] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:46 2022] GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:47.750576 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-3cbfd93b-e2f8-4518-af04-28a50ecd5484 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:47.751321 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-3cbfd93b-e2f8-4518-af04-28a50ecd5484 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:47.759455 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3cbfd93b-e2f8-4518-af04-28a50ecd5484 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:47.759945 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3cbfd93b-e2f8-4518-af04-28a50ecd5484 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:47.760407 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3cbfd93b-e2f8-4518-af04-28a50ecd5484 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:47.761106 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3cbfd93b-e2f8-4518-af04-28a50ecd5484 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:47.761603 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3cbfd93b-e2f8-4518-af04-28a50ecd5484 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:47.762030 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3cbfd93b-e2f8-4518-af04-28a50ecd5484 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:47.898114 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-3cbfd93b-e2f8-4518-af04-28a50ecd5484 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:47.906182 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-3cbfd93b-e2f8-4518-af04-28a50ecd5484 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1522 microversion: 2.1 time: 0.159138 Aug 10 13:38:47.907423 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 57/139] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:47 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:48.176101 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-4804a647-a743-4b16-8e0b-d248e755eb60 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:48.176709 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-4804a647-a743-4b16-8e0b-d248e755eb60 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] [instance: a3e6b964-a4d5-4c24-8c8c-19373ddd2fff] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:48.178666 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell0:SELECT=4 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:38:48.184355 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4804a647-a743-4b16-8e0b-d248e755eb60 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:48.184830 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4804a647-a743-4b16-8e0b-d248e755eb60 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:48.185278 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4804a647-a743-4b16-8e0b-d248e755eb60 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:48.186006 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4804a647-a743-4b16-8e0b-d248e755eb60 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:48.186452 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4804a647-a743-4b16-8e0b-d248e755eb60 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:48.186866 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4804a647-a743-4b16-8e0b-d248e755eb60 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:48.201440 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.wsgi [None req-4804a647-a743-4b16-8e0b-d248e755eb60 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] HTTP exception thrown: Instance a3e6b964-a4d5-4c24-8c8c-19373ddd2fff could not be found. Aug 10 13:38:48.206228 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-4804a647-a743-4b16-8e0b-d248e755eb60 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Request method failure captured: Aug 10 13:38:48.206228 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: request: GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff HTTP/1.1 Aug 10 13:38:48.206228 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept: application/json Aug 10 13:38:48.206228 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept-Encoding: identity Aug 10 13:38:48.206228 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Connection: close Aug 10 13:38:48.206228 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Length: 0 Aug 10 13:38:48.206228 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Type: application/json Aug 10 13:38:48.206228 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Host: 10.222.0.52 Aug 10 13:38:48.206228 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Openstack-System-Scope: None Aug 10 13:38:48.206228 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: User-Agent: python-urllib3/1.26.11 Aug 10 13:38:48.206228 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Auth-Token: gAAAAABi87SstDvlTXpvlejlNi-FywpVSMtyFuEkNmMFqV8X9t-x_zWEdKbxlZRcrgAVcyhZVzxPbXlBB9zy1BdW9twtfC7KP8pQg7lunf75-Vo1d_7e_mk76muiydqROUR0T1TTGhHL0L-jkH0BaMTPaniDiJpUdBTnJz9CIieClURL1rUD8Gw Aug 10 13:38:48.206228 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Id: None Aug 10 13:38:48.206228 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Name: None Aug 10 13:38:48.206228 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Identity-Status: Confirmed Aug 10 13:38:48.206228 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Is-Admin-Project: True Aug 10 13:38:48.206228 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Id: default Aug 10 13:38:48.206228 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Name: Default Aug 10 13:38:48.206228 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Id: 18c99d576d184b04b933db13eabb8c5e Aug 10 13:38:48.206228 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Name: tempest-DeleteServersTestJSON-1309216337 Aug 10 13:38:48.206228 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Role: member,reader Aug 10 13:38:48.206228 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Roles: member,reader Aug 10 13:38:48.207676 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/18c99d576d184b04b933db13eabb8c5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/18c99d576d184b04b933db13eabb8c5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_18c99d576d184b04b933db13eabb8c5e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/18c99d576d184b04b933db13eabb8c5e"}]}] Aug 10 13:38:48.207676 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant: tempest-DeleteServersTestJSON-1309216337 Aug 10 13:38:48.207676 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Id: 18c99d576d184b04b933db13eabb8c5e Aug 10 13:38:48.207676 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Name: tempest-DeleteServersTestJSON-1309216337 Aug 10 13:38:48.207676 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User: tempest-DeleteServersTestJSON-1309216337-project Aug 10 13:38:48.207676 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Id: default Aug 10 13:38:48.207676 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Name: Default Aug 10 13:38:48.207676 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Id: 258ccb4bb15a4747b4c17d2a26645888 Aug 10 13:38:48.207676 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Name: tempest-DeleteServersTestJSON-1309216337-project Aug 10 13:38:48.207676 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: method: > Aug 10 13:38:48.207676 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: exception: Instance a3e6b964-a4d5-4c24-8c8c-19373ddd2fff could not be found. Aug 10 13:38:48.207676 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: action_args: {'id': 'a3e6b964-a4d5-4c24-8c8c-19373ddd2fff'} Aug 10 13:38:48.208511 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:38:48.208511 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:38:48.208511 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:38:48.208511 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:38:48.208511 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:38:48.208511 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:38:48.208511 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:38:48.208511 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:38:48.208511 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:38:48.208511 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:38:48.208511 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3e6b964-a4d5-4c24-8c8c-19373ddd2fff could not be found. Aug 10 13:38:48.208511 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:38:48.208511 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:38:48.208511 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:38:48.208511 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:38:48.208511 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:38:48.208511 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:38:48.208511 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:38:48.208511 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:38:48.208511 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:38:48.210056 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:38:48.210056 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:38:48.210056 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:38:48.210056 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:38:48.210056 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:38:48.210056 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:38:48.210056 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:38:48.210056 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3e6b964-a4d5-4c24-8c8c-19373ddd2fff could not be found. Aug 10 13:38:48.210056 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:38:48.210056 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:38:48.210056 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:38:48.210056 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:38:48.210056 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:38:48.210056 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:38:48.210056 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:38:48.210056 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:38:48.210056 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3e6b964-a4d5-4c24-8c8c-19373ddd2fff could not be found. Aug 10 13:38:48.210056 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:38:48.211282 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-4804a647-a743-4b16-8e0b-d248e755eb60 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Returning 404 to user: Instance a3e6b964-a4d5-4c24-8c8c-19373ddd2fff could not be found. {{(pid=129522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:38:48.211282 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-4804a647-a743-4b16-8e0b-d248e755eb60 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] 10.222.0.52 "GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff" status: 404 len: 111 microversion: 2.1 time: 0.035748 Aug 10 13:38:48.211669 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 83/140] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:48 2022] GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:38:48.321677 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-eb537461-373d-4dfc-a613-b8240b36d160 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:48.323806 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-eb537461-373d-4dfc-a613-b8240b36d160 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] [instance: a3e6b964-a4d5-4c24-8c8c-19373ddd2fff] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:48.329736 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-eb537461-373d-4dfc-a613-b8240b36d160 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:48.330222 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-eb537461-373d-4dfc-a613-b8240b36d160 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:48.330668 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-eb537461-373d-4dfc-a613-b8240b36d160 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:48.331348 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-eb537461-373d-4dfc-a613-b8240b36d160 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:48.331797 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-eb537461-373d-4dfc-a613-b8240b36d160 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:48.332356 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-eb537461-373d-4dfc-a613-b8240b36d160 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:48.347131 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.wsgi [None req-eb537461-373d-4dfc-a613-b8240b36d160 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] HTTP exception thrown: Instance a3e6b964-a4d5-4c24-8c8c-19373ddd2fff could not be found. Aug 10 13:38:48.352154 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-eb537461-373d-4dfc-a613-b8240b36d160 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Request method failure captured: Aug 10 13:38:48.352154 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: request: GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff/os-volume_attachments HTTP/1.1 Aug 10 13:38:48.352154 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept: application/json Aug 10 13:38:48.352154 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept-Encoding: identity Aug 10 13:38:48.352154 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Connection: close Aug 10 13:38:48.352154 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Length: 0 Aug 10 13:38:48.352154 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Type: application/json Aug 10 13:38:48.352154 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Host: 10.222.0.52 Aug 10 13:38:48.352154 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Openstack-System-Scope: None Aug 10 13:38:48.352154 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: User-Agent: python-urllib3/1.26.11 Aug 10 13:38:48.352154 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Auth-Token: gAAAAABi87SstDvlTXpvlejlNi-FywpVSMtyFuEkNmMFqV8X9t-x_zWEdKbxlZRcrgAVcyhZVzxPbXlBB9zy1BdW9twtfC7KP8pQg7lunf75-Vo1d_7e_mk76muiydqROUR0T1TTGhHL0L-jkH0BaMTPaniDiJpUdBTnJz9CIieClURL1rUD8Gw Aug 10 13:38:48.352154 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Id: None Aug 10 13:38:48.352154 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Name: None Aug 10 13:38:48.352154 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Identity-Status: Confirmed Aug 10 13:38:48.352154 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Is-Admin-Project: True Aug 10 13:38:48.352154 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Id: default Aug 10 13:38:48.352154 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Name: Default Aug 10 13:38:48.352154 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Id: 18c99d576d184b04b933db13eabb8c5e Aug 10 13:38:48.352154 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Name: tempest-DeleteServersTestJSON-1309216337 Aug 10 13:38:48.352154 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Role: member,reader Aug 10 13:38:48.352154 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Roles: member,reader Aug 10 13:38:48.353674 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/18c99d576d184b04b933db13eabb8c5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/18c99d576d184b04b933db13eabb8c5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_18c99d576d184b04b933db13eabb8c5e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/18c99d576d184b04b933db13eabb8c5e"}]}] Aug 10 13:38:48.353674 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant: tempest-DeleteServersTestJSON-1309216337 Aug 10 13:38:48.353674 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Id: 18c99d576d184b04b933db13eabb8c5e Aug 10 13:38:48.353674 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Name: tempest-DeleteServersTestJSON-1309216337 Aug 10 13:38:48.353674 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User: tempest-DeleteServersTestJSON-1309216337-project Aug 10 13:38:48.353674 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Id: default Aug 10 13:38:48.353674 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Name: Default Aug 10 13:38:48.353674 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Id: 258ccb4bb15a4747b4c17d2a26645888 Aug 10 13:38:48.353674 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Name: tempest-DeleteServersTestJSON-1309216337-project Aug 10 13:38:48.353674 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: method: > Aug 10 13:38:48.353674 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: exception: Instance a3e6b964-a4d5-4c24-8c8c-19373ddd2fff could not be found. Aug 10 13:38:48.353674 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: action_args: {'server_id': 'a3e6b964-a4d5-4c24-8c8c-19373ddd2fff'} Aug 10 13:38:48.354478 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:38:48.354478 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:38:48.354478 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:38:48.354478 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:38:48.354478 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:38:48.354478 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:38:48.354478 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:38:48.354478 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:38:48.354478 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:38:48.354478 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:38:48.354478 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3e6b964-a4d5-4c24-8c8c-19373ddd2fff could not be found. Aug 10 13:38:48.354478 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:38:48.354478 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:38:48.354478 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:38:48.354478 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:38:48.354478 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:38:48.354478 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:38:48.354478 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:38:48.354478 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:38:48.354478 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:38:48.355505 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:38:48.355505 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 13:38:48.355505 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 13:38:48.355505 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 13:38:48.355505 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 13:38:48.355505 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 10 13:38:48.355505 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 10 13:38:48.355505 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:38:48.355505 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:38:48.355505 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3e6b964-a4d5-4c24-8c8c-19373ddd2fff could not be found. Aug 10 13:38:48.355505 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:38:48.355505 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:38:48.355505 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:38:48.355505 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:38:48.355505 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:38:48.355505 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:38:48.355505 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:38:48.355505 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:38:48.355505 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3e6b964-a4d5-4c24-8c8c-19373ddd2fff could not be found. Aug 10 13:38:48.355505 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:38:48.356538 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-eb537461-373d-4dfc-a613-b8240b36d160 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Returning 404 to user: Instance a3e6b964-a4d5-4c24-8c8c-19373ddd2fff could not be found. {{(pid=129523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:38:48.356538 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-eb537461-373d-4dfc-a613-b8240b36d160 tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] 10.222.0.52 "GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036689 Aug 10 13:38:48.356538 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 58/141] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 10 13:38:48 2022] GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:38:48.928717 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-932e63de-8d80-498f-9e88-5699aba6a619 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:48.929556 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-932e63de-8d80-498f-9e88-5699aba6a619 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:48.935526 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-932e63de-8d80-498f-9e88-5699aba6a619 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:48.936000 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-932e63de-8d80-498f-9e88-5699aba6a619 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:48.936427 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-932e63de-8d80-498f-9e88-5699aba6a619 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:48.937104 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-932e63de-8d80-498f-9e88-5699aba6a619 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:48.937580 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-932e63de-8d80-498f-9e88-5699aba6a619 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:48.937998 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-932e63de-8d80-498f-9e88-5699aba6a619 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:49.074127 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-932e63de-8d80-498f-9e88-5699aba6a619 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:49.081764 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-932e63de-8d80-498f-9e88-5699aba6a619 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1522 microversion: 2.1 time: 0.157915 Aug 10 13:38:49.082339 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 84/142] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:48 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:49.556611 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-506fee2f-6733-46e1-bd49-9bcb511170de tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:49.557137 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-506fee2f-6733-46e1-bd49-9bcb511170de tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] [instance: a3e6b964-a4d5-4c24-8c8c-19373ddd2fff] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:49.563158 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-506fee2f-6733-46e1-bd49-9bcb511170de tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:49.563634 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-506fee2f-6733-46e1-bd49-9bcb511170de tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:49.564063 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-506fee2f-6733-46e1-bd49-9bcb511170de tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:49.564737 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-506fee2f-6733-46e1-bd49-9bcb511170de tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:49.565185 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-506fee2f-6733-46e1-bd49-9bcb511170de tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:49.565628 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-506fee2f-6733-46e1-bd49-9bcb511170de tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:49.578904 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.wsgi [None req-506fee2f-6733-46e1-bd49-9bcb511170de tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] HTTP exception thrown: Instance a3e6b964-a4d5-4c24-8c8c-19373ddd2fff could not be found. Aug 10 13:38:49.580989 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-506fee2f-6733-46e1-bd49-9bcb511170de tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Request method failure captured: Aug 10 13:38:49.580989 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: request: DELETE /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff HTTP/1.1 Aug 10 13:38:49.580989 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept: application/json Aug 10 13:38:49.580989 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept-Encoding: identity Aug 10 13:38:49.580989 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Connection: close Aug 10 13:38:49.580989 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Length: 0 Aug 10 13:38:49.580989 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Type: application/json Aug 10 13:38:49.580989 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Host: 10.222.0.52 Aug 10 13:38:49.580989 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Openstack-System-Scope: None Aug 10 13:38:49.580989 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: User-Agent: python-urllib3/1.26.11 Aug 10 13:38:49.580989 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Auth-Token: gAAAAABi87SstDvlTXpvlejlNi-FywpVSMtyFuEkNmMFqV8X9t-x_zWEdKbxlZRcrgAVcyhZVzxPbXlBB9zy1BdW9twtfC7KP8pQg7lunf75-Vo1d_7e_mk76muiydqROUR0T1TTGhHL0L-jkH0BaMTPaniDiJpUdBTnJz9CIieClURL1rUD8Gw Aug 10 13:38:49.580989 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Id: None Aug 10 13:38:49.580989 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Name: None Aug 10 13:38:49.580989 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Identity-Status: Confirmed Aug 10 13:38:49.580989 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Is-Admin-Project: True Aug 10 13:38:49.580989 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Id: default Aug 10 13:38:49.580989 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Name: Default Aug 10 13:38:49.580989 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Id: 18c99d576d184b04b933db13eabb8c5e Aug 10 13:38:49.580989 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Name: tempest-DeleteServersTestJSON-1309216337 Aug 10 13:38:49.580989 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Role: member,reader Aug 10 13:38:49.580989 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Roles: member,reader Aug 10 13:38:49.582413 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/18c99d576d184b04b933db13eabb8c5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/18c99d576d184b04b933db13eabb8c5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_18c99d576d184b04b933db13eabb8c5e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/18c99d576d184b04b933db13eabb8c5e"}]}] Aug 10 13:38:49.582413 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant: tempest-DeleteServersTestJSON-1309216337 Aug 10 13:38:49.582413 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Id: 18c99d576d184b04b933db13eabb8c5e Aug 10 13:38:49.582413 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Name: tempest-DeleteServersTestJSON-1309216337 Aug 10 13:38:49.582413 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User: tempest-DeleteServersTestJSON-1309216337-project Aug 10 13:38:49.582413 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Id: default Aug 10 13:38:49.582413 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Name: Default Aug 10 13:38:49.582413 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Id: 258ccb4bb15a4747b4c17d2a26645888 Aug 10 13:38:49.582413 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Name: tempest-DeleteServersTestJSON-1309216337-project Aug 10 13:38:49.582413 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: method: > Aug 10 13:38:49.582413 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: exception: Instance a3e6b964-a4d5-4c24-8c8c-19373ddd2fff could not be found. Aug 10 13:38:49.582413 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: action_args: {'id': 'a3e6b964-a4d5-4c24-8c8c-19373ddd2fff'} Aug 10 13:38:49.583221 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:38:49.583221 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:38:49.583221 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:38:49.583221 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:38:49.583221 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:38:49.583221 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:38:49.583221 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:38:49.583221 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:38:49.583221 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:38:49.583221 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:38:49.583221 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3e6b964-a4d5-4c24-8c8c-19373ddd2fff could not be found. Aug 10 13:38:49.583221 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:38:49.583221 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:38:49.583221 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:38:49.583221 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:38:49.583221 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:38:49.583221 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:38:49.583221 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:38:49.583221 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:38:49.583221 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:38:49.584515 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:38:49.584515 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 13:38:49.584515 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 13:38:49.584515 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 13:38:49.584515 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 13:38:49.584515 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:38:49.584515 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:38:49.584515 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:38:49.584515 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:38:49.584515 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3e6b964-a4d5-4c24-8c8c-19373ddd2fff could not be found. Aug 10 13:38:49.584515 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:38:49.584515 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:38:49.584515 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:38:49.584515 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:38:49.584515 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:38:49.584515 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:38:49.584515 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:38:49.584515 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:38:49.584515 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3e6b964-a4d5-4c24-8c8c-19373ddd2fff could not be found. Aug 10 13:38:49.584515 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:38:49.585860 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-506fee2f-6733-46e1-bd49-9bcb511170de tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Returning 404 to user: Instance a3e6b964-a4d5-4c24-8c8c-19373ddd2fff could not be found. {{(pid=129523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:38:49.585860 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-506fee2f-6733-46e1-bd49-9bcb511170de tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff" status: 404 len: 111 microversion: 2.1 time: 0.030276 Aug 10 13:38:49.585860 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 59/143] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 10 13:38:49 2022] DELETE /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:38:49.590650 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-25d6f976-73b3-48af-8b37-6d638c28f16f tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:49.591291 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-25d6f976-73b3-48af-8b37-6d638c28f16f tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] [instance: a3e6b964-a4d5-4c24-8c8c-19373ddd2fff] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:49.597332 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-25d6f976-73b3-48af-8b37-6d638c28f16f tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:49.597816 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-25d6f976-73b3-48af-8b37-6d638c28f16f tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:49.598247 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-25d6f976-73b3-48af-8b37-6d638c28f16f tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:49.598926 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-25d6f976-73b3-48af-8b37-6d638c28f16f tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:49.599379 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-25d6f976-73b3-48af-8b37-6d638c28f16f tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:49.599796 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-25d6f976-73b3-48af-8b37-6d638c28f16f tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:49.613483 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.wsgi [None req-25d6f976-73b3-48af-8b37-6d638c28f16f tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] HTTP exception thrown: Instance a3e6b964-a4d5-4c24-8c8c-19373ddd2fff could not be found. Aug 10 13:38:49.614976 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-25d6f976-73b3-48af-8b37-6d638c28f16f tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Request method failure captured: Aug 10 13:38:49.614976 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: request: GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff HTTP/1.1 Aug 10 13:38:49.614976 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept: application/json Aug 10 13:38:49.614976 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept-Encoding: identity Aug 10 13:38:49.614976 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Connection: close Aug 10 13:38:49.614976 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Length: 0 Aug 10 13:38:49.614976 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Type: application/json Aug 10 13:38:49.614976 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Host: 10.222.0.52 Aug 10 13:38:49.614976 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Openstack-System-Scope: None Aug 10 13:38:49.614976 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: User-Agent: python-urllib3/1.26.11 Aug 10 13:38:49.614976 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Auth-Token: gAAAAABi87SstDvlTXpvlejlNi-FywpVSMtyFuEkNmMFqV8X9t-x_zWEdKbxlZRcrgAVcyhZVzxPbXlBB9zy1BdW9twtfC7KP8pQg7lunf75-Vo1d_7e_mk76muiydqROUR0T1TTGhHL0L-jkH0BaMTPaniDiJpUdBTnJz9CIieClURL1rUD8Gw Aug 10 13:38:49.614976 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Id: None Aug 10 13:38:49.614976 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Name: None Aug 10 13:38:49.614976 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Identity-Status: Confirmed Aug 10 13:38:49.614976 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Is-Admin-Project: True Aug 10 13:38:49.614976 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Id: default Aug 10 13:38:49.614976 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Name: Default Aug 10 13:38:49.614976 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Id: 18c99d576d184b04b933db13eabb8c5e Aug 10 13:38:49.614976 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Name: tempest-DeleteServersTestJSON-1309216337 Aug 10 13:38:49.614976 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Role: member,reader Aug 10 13:38:49.614976 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Roles: member,reader Aug 10 13:38:49.616888 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/18c99d576d184b04b933db13eabb8c5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/18c99d576d184b04b933db13eabb8c5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_18c99d576d184b04b933db13eabb8c5e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/18c99d576d184b04b933db13eabb8c5e"}]}] Aug 10 13:38:49.616888 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant: tempest-DeleteServersTestJSON-1309216337 Aug 10 13:38:49.616888 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Id: 18c99d576d184b04b933db13eabb8c5e Aug 10 13:38:49.616888 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Name: tempest-DeleteServersTestJSON-1309216337 Aug 10 13:38:49.616888 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User: tempest-DeleteServersTestJSON-1309216337-project Aug 10 13:38:49.616888 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Id: default Aug 10 13:38:49.616888 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Name: Default Aug 10 13:38:49.616888 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Id: 258ccb4bb15a4747b4c17d2a26645888 Aug 10 13:38:49.616888 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Name: tempest-DeleteServersTestJSON-1309216337-project Aug 10 13:38:49.616888 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: method: > Aug 10 13:38:49.616888 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: exception: Instance a3e6b964-a4d5-4c24-8c8c-19373ddd2fff could not be found. Aug 10 13:38:49.616888 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: action_args: {'id': 'a3e6b964-a4d5-4c24-8c8c-19373ddd2fff'} Aug 10 13:38:49.617714 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:38:49.617714 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:38:49.617714 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:38:49.617714 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:38:49.617714 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:38:49.617714 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:38:49.617714 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:38:49.617714 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:38:49.617714 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:38:49.617714 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:38:49.617714 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3e6b964-a4d5-4c24-8c8c-19373ddd2fff could not be found. Aug 10 13:38:49.617714 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:38:49.617714 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:38:49.617714 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:38:49.617714 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:38:49.617714 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:38:49.617714 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:38:49.617714 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:38:49.617714 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:38:49.617714 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:38:49.618997 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:38:49.618997 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:38:49.618997 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:38:49.618997 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:38:49.618997 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:38:49.618997 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:38:49.618997 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:38:49.618997 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3e6b964-a4d5-4c24-8c8c-19373ddd2fff could not be found. Aug 10 13:38:49.618997 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:38:49.618997 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:38:49.618997 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:38:49.618997 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:38:49.618997 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:38:49.618997 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:38:49.618997 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:38:49.618997 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:38:49.618997 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3e6b964-a4d5-4c24-8c8c-19373ddd2fff could not be found. Aug 10 13:38:49.618997 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:38:49.620130 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-25d6f976-73b3-48af-8b37-6d638c28f16f tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] Returning 404 to user: Instance a3e6b964-a4d5-4c24-8c8c-19373ddd2fff could not be found. {{(pid=129522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:38:49.620130 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-25d6f976-73b3-48af-8b37-6d638c28f16f tempest-DeleteServersTestJSON-1309216337 tempest-DeleteServersTestJSON-1309216337-project] 10.222.0.52 "GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff" status: 404 len: 111 microversion: 2.1 time: 0.030248 Aug 10 13:38:49.620130 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 85/144] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:49 2022] GET /compute/v2.1/servers/a3e6b964-a4d5-4c24-8c8c-19373ddd2fff => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:38:50.104401 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-28d118dd-f788-4f57-9704-d604c4247fac tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:50.105122 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-28d118dd-f788-4f57-9704-d604c4247fac tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:50.111271 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-28d118dd-f788-4f57-9704-d604c4247fac tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:50.111829 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-28d118dd-f788-4f57-9704-d604c4247fac tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:50.112620 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-28d118dd-f788-4f57-9704-d604c4247fac tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:50.113432 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-28d118dd-f788-4f57-9704-d604c4247fac tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:50.113983 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-28d118dd-f788-4f57-9704-d604c4247fac tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:50.114451 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-28d118dd-f788-4f57-9704-d604c4247fac tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:50.368394 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-28d118dd-f788-4f57-9704-d604c4247fac tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:50.376566 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-28d118dd-f788-4f57-9704-d604c4247fac tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1522 microversion: 2.1 time: 0.277254 Aug 10 13:38:50.377336 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 60/145] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:50 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:51.397051 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-888f5372-4d80-4bc7-b121-005a35f6ae69 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:51.398186 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-888f5372-4d80-4bc7-b121-005a35f6ae69 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:51.405447 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-888f5372-4d80-4bc7-b121-005a35f6ae69 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:51.405956 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-888f5372-4d80-4bc7-b121-005a35f6ae69 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:51.406385 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-888f5372-4d80-4bc7-b121-005a35f6ae69 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:51.407078 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-888f5372-4d80-4bc7-b121-005a35f6ae69 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:51.407529 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-888f5372-4d80-4bc7-b121-005a35f6ae69 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:51.407949 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-888f5372-4d80-4bc7-b121-005a35f6ae69 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:51.679829 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-888f5372-4d80-4bc7-b121-005a35f6ae69 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:51.688112 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-888f5372-4d80-4bc7-b121-005a35f6ae69 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1522 microversion: 2.1 time: 0.295138 Aug 10 13:38:51.688814 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 86/146] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:51 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:52.708919 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-5977aacb-76b0-47ae-b6e2-f65735992e08 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:52.709790 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-5977aacb-76b0-47ae-b6e2-f65735992e08 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:52.716941 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5977aacb-76b0-47ae-b6e2-f65735992e08 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:52.717467 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5977aacb-76b0-47ae-b6e2-f65735992e08 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:52.718108 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5977aacb-76b0-47ae-b6e2-f65735992e08 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:52.718985 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5977aacb-76b0-47ae-b6e2-f65735992e08 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:52.719473 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5977aacb-76b0-47ae-b6e2-f65735992e08 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:52.719901 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5977aacb-76b0-47ae-b6e2-f65735992e08 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:52.929084 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-5977aacb-76b0-47ae-b6e2-f65735992e08 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:52.938214 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-5977aacb-76b0-47ae-b6e2-f65735992e08 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1522 microversion: 2.1 time: 0.233024 Aug 10 13:38:52.938987 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 61/147] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:52 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:53.961867 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-e7c3896b-3e29-4d07-9041-2c8d89f7ff81 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:53.963194 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-e7c3896b-3e29-4d07-9041-2c8d89f7ff81 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:53.973437 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e7c3896b-3e29-4d07-9041-2c8d89f7ff81 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:53.974354 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e7c3896b-3e29-4d07-9041-2c8d89f7ff81 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:53.974925 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e7c3896b-3e29-4d07-9041-2c8d89f7ff81 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:53.988648 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e7c3896b-3e29-4d07-9041-2c8d89f7ff81 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:53.989302 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e7c3896b-3e29-4d07-9041-2c8d89f7ff81 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:53.989888 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e7c3896b-3e29-4d07-9041-2c8d89f7ff81 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:54.131903 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-e7c3896b-3e29-4d07-9041-2c8d89f7ff81 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:54.140551 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-e7c3896b-3e29-4d07-9041-2c8d89f7ff81 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1522 microversion: 2.1 time: 0.184896 Aug 10 13:38:54.141454 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 87/148] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:53 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:54.645532 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-78eef7ec-7c6f-4b08-952f-011dd020fc37 tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] Action: 'create', calling method: .version_select at 0x7f49c5b32160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1898441664"}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:38:54.944900 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-78eef7ec-7c6f-4b08-952f-011dd020fc37 tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.415447 Aug 10 13:38:54.945700 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 62/149] 10.222.0.52 () {60 vars in 1155 bytes} [Wed Aug 10 13:38:54 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 417 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 10 13:38:54.958180 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-70293fba-8829-4da8-877a-c4aadf0189fb tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] Calling method '.version_select at 0x7f49c47e09d0>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:55.016191 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-70293fba-8829-4da8-877a-c4aadf0189fb tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e" status: 200 len: 345 microversion: 2.1 time: 0.062090 Aug 10 13:38:55.022618 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 88/150] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 10 13:38:54 2022] GET /compute/v2.1/os-volumes/a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:38:55.163363 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-1ab2dccc-c32d-46ab-8c13-ca37d6cb2f6c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:55.164419 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-1ab2dccc-c32d-46ab-8c13-ca37d6cb2f6c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:55.171169 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1ab2dccc-c32d-46ab-8c13-ca37d6cb2f6c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:55.171842 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1ab2dccc-c32d-46ab-8c13-ca37d6cb2f6c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:55.172285 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1ab2dccc-c32d-46ab-8c13-ca37d6cb2f6c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:55.173573 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1ab2dccc-c32d-46ab-8c13-ca37d6cb2f6c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:55.174024 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1ab2dccc-c32d-46ab-8c13-ca37d6cb2f6c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:55.174516 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1ab2dccc-c32d-46ab-8c13-ca37d6cb2f6c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:55.331191 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-1ab2dccc-c32d-46ab-8c13-ca37d6cb2f6c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:55.339964 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-1ab2dccc-c32d-46ab-8c13-ca37d6cb2f6c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1522 microversion: 2.1 time: 0.181781 Aug 10 13:38:55.340562 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 63/151] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:55 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:56.030835 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-898de92f-b446-4327-be41-c8d4b41a194a tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] Calling method '.version_select at 0x7f49c47dcee0>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:56.080511 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-898de92f-b446-4327-be41-c8d4b41a194a tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e" status: 200 len: 346 microversion: 2.1 time: 0.054074 Aug 10 13:38:56.081081 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 89/152] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 10 13:38:56 2022] GET /compute/v2.1/os-volumes/a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:38:56.093700 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-6c979f7d-0bf3-401f-8112-12bc486de5f6 tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] Action: 'create', calling method: .version_select at 0x7f49c477a430>, body: {"snapshot": {"volume_id": "a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1099598888"}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:38:56.254732 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-6c979f7d-0bf3-401f-8112-12bc486de5f6 tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] 10.222.0.52 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.164701 Aug 10 13:38:56.255415 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 64/153] 10.222.0.52 () {60 vars in 1162 bytes} [Wed Aug 10 13:38:56 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:38:56.270693 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-66a4b0cb-a60f-47d2-a40e-41b3d9d4215e tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] Calling method '.version_select at 0x7f49c47e8160>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:56.304156 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-66a4b0cb-a60f-47d2-a40e-41b3d9d4215e tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/8796f129-8b47-4dd0-9478-23d8992b77d7" status: 200 len: 287 microversion: 2.1 time: 0.038338 Aug 10 13:38:56.304730 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 90/154] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Aug 10 13:38:56 2022] GET /compute/v2.1/os-snapshots/8796f129-8b47-4dd0-9478-23d8992b77d7 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:38:56.317475 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-8b2d536d-be15-431f-a2ec-2bed59e7ebde tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] Calling method '.version_select at 0x7f49c47c78b0>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:56.360626 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-cdce189d-5235-44d7-b3a5-2d4c50734514 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:56.360832 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-8b2d536d-be15-431f-a2ec-2bed59e7ebde tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.047812 Aug 10 13:38:56.361494 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-cdce189d-5235-44d7-b3a5-2d4c50734514 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:56.361657 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 65/155] 10.222.0.52 () {58 vars in 1140 bytes} [Wed Aug 10 13:38:56 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:38:56.368817 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cdce189d-5235-44d7-b3a5-2d4c50734514 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:56.369447 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cdce189d-5235-44d7-b3a5-2d4c50734514 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:56.369959 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cdce189d-5235-44d7-b3a5-2d4c50734514 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:56.370722 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cdce189d-5235-44d7-b3a5-2d4c50734514 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:56.371266 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cdce189d-5235-44d7-b3a5-2d4c50734514 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:56.371643 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cdce189d-5235-44d7-b3a5-2d4c50734514 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:56.373112 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-833c61f1-27ce-4623-94ef-6e9d0fa08aa5 tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] Calling method '.version_select at 0x7f49c47f41f0>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:56.405925 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-833c61f1-27ce-4623-94ef-6e9d0fa08aa5 tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/8796f129-8b47-4dd0-9478-23d8992b77d7" status: 200 len: 287 microversion: 2.1 time: 0.036641 Aug 10 13:38:56.406504 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 66/156] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Aug 10 13:38:56 2022] GET /compute/v2.1/os-snapshots/8796f129-8b47-4dd0-9478-23d8992b77d7 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:38:56.544084 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-cdce189d-5235-44d7-b3a5-2d4c50734514 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:56.552189 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-cdce189d-5235-44d7-b3a5-2d4c50734514 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1522 microversion: 2.1 time: 0.195583 Aug 10 13:38:56.553130 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 91/157] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:56 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:38:57.419145 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-f6d73af6-afb0-4503-9c3f-3dc74da6939e tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] Calling method '.version_select at 0x7f49c47bc0d0>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:57.447213 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-f6d73af6-afb0-4503-9c3f-3dc74da6939e tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/8796f129-8b47-4dd0-9478-23d8992b77d7" status: 200 len: 287 microversion: 2.1 time: 0.032058 Aug 10 13:38:57.447762 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 67/158] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Aug 10 13:38:57 2022] GET /compute/v2.1/os-snapshots/8796f129-8b47-4dd0-9478-23d8992b77d7 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:38:57.572845 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-9c4c7fd1-873b-4968-83ac-0ca06def8bf6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:57.573528 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-9c4c7fd1-873b-4968-83ac-0ca06def8bf6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:57.579810 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9c4c7fd1-873b-4968-83ac-0ca06def8bf6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:57.580290 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9c4c7fd1-873b-4968-83ac-0ca06def8bf6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:57.580719 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9c4c7fd1-873b-4968-83ac-0ca06def8bf6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:57.581436 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9c4c7fd1-873b-4968-83ac-0ca06def8bf6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:57.581884 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9c4c7fd1-873b-4968-83ac-0ca06def8bf6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:57.582384 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9c4c7fd1-873b-4968-83ac-0ca06def8bf6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:57.711810 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-9c4c7fd1-873b-4968-83ac-0ca06def8bf6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:57.719138 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-9c4c7fd1-873b-4968-83ac-0ca06def8bf6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1522 microversion: 2.1 time: 0.150093 Aug 10 13:38:57.719702 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 92/159] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:57 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:58.459193 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-e4558928-1215-4778-9c6f-35bd51763857 tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] Calling method '.version_select at 0x7f49c48f8a60>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:58.488471 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-e4558928-1215-4778-9c6f-35bd51763857 tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/8796f129-8b47-4dd0-9478-23d8992b77d7" status: 200 len: 287 microversion: 2.1 time: 0.033211 Aug 10 13:38:58.489015 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 68/160] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Aug 10 13:38:58 2022] GET /compute/v2.1/os-snapshots/8796f129-8b47-4dd0-9478-23d8992b77d7 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:38:58.740420 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-59bf0b80-10e4-4f65-8eed-f87d30c3a11b tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:58.741644 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-59bf0b80-10e4-4f65-8eed-f87d30c3a11b tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:58.747622 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-59bf0b80-10e4-4f65-8eed-f87d30c3a11b tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:58.748112 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-59bf0b80-10e4-4f65-8eed-f87d30c3a11b tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:58.748550 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-59bf0b80-10e4-4f65-8eed-f87d30c3a11b tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:58.749322 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-59bf0b80-10e4-4f65-8eed-f87d30c3a11b tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:58.749789 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-59bf0b80-10e4-4f65-8eed-f87d30c3a11b tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:58.750213 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-59bf0b80-10e4-4f65-8eed-f87d30c3a11b tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:58.880851 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-59bf0b80-10e4-4f65-8eed-f87d30c3a11b tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:38:58.888659 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-59bf0b80-10e4-4f65-8eed-f87d30c3a11b tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1522 microversion: 2.1 time: 0.152400 Aug 10 13:38:58.889267 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 93/161] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:58 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:38:59.501972 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-17073310-42e5-4a80-90e4-29b66b8e2e32 tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] Calling method '.version_select at 0x7f49c477a550>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:59.535432 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-17073310-42e5-4a80-90e4-29b66b8e2e32 tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/8796f129-8b47-4dd0-9478-23d8992b77d7" status: 200 len: 287 microversion: 2.1 time: 0.037700 Aug 10 13:38:59.536003 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 69/162] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Aug 10 13:38:59 2022] GET /compute/v2.1/os-snapshots/8796f129-8b47-4dd0-9478-23d8992b77d7 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:38:59.910116 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-7016c13a-e77a-4303-b42c-37c9851a4c31 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:38:59.910731 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-7016c13a-e77a-4303-b42c-37c9851a4c31 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:38:59.917840 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7016c13a-e77a-4303-b42c-37c9851a4c31 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:59.918319 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7016c13a-e77a-4303-b42c-37c9851a4c31 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:59.918752 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7016c13a-e77a-4303-b42c-37c9851a4c31 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:38:59.919434 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7016c13a-e77a-4303-b42c-37c9851a4c31 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:38:59.919884 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7016c13a-e77a-4303-b42c-37c9851a4c31 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:38:59.920302 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7016c13a-e77a-4303-b42c-37c9851a4c31 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:00.055565 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-7016c13a-e77a-4303-b42c-37c9851a4c31 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:00.064249 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-7016c13a-e77a-4303-b42c-37c9851a4c31 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1522 microversion: 2.1 time: 0.157653 Aug 10 13:39:00.065025 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 94/163] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:38:59 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:39:00.547944 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-ec8d61ce-7ac3-4842-8946-424ec04cb1a1 tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] Calling method '.version_select at 0x7f49c477af70>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:00.576644 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-ec8d61ce-7ac3-4842-8946-424ec04cb1a1 tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/8796f129-8b47-4dd0-9478-23d8992b77d7" status: 200 len: 288 microversion: 2.1 time: 0.032428 Aug 10 13:39:00.577202 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 70/164] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Aug 10 13:39:00 2022] GET /compute/v2.1/os-snapshots/8796f129-8b47-4dd0-9478-23d8992b77d7 => generated 288 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:39:00.588354 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-485c7607-404c-44ef-b095-77f20edc5af6 tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] Calling method '.version_select at 0x7f49c47e8e50>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:00.647726 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-485c7607-404c-44ef-b095-77f20edc5af6 tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] 10.222.0.52 "DELETE /compute/v2.1/os-snapshots/8796f129-8b47-4dd0-9478-23d8992b77d7" status: 202 len: 0 microversion: 2.1 time: 0.063546 Aug 10 13:39:00.648373 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 95/165] 10.222.0.52 () {58 vars in 1254 bytes} [Wed Aug 10 13:39:00 2022] DELETE /compute/v2.1/os-snapshots/8796f129-8b47-4dd0-9478-23d8992b77d7 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:39:00.657438 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-3f72d488-ed27-4af4-ab84-f5d72580398d tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] Calling method '.version_select at 0x7f49c477ab80>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:00.687359 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-3f72d488-ed27-4af4-ab84-f5d72580398d tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/8796f129-8b47-4dd0-9478-23d8992b77d7" status: 200 len: 287 microversion: 2.1 time: 0.033995 Aug 10 13:39:00.687933 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 71/166] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Aug 10 13:39:00 2022] GET /compute/v2.1/os-snapshots/8796f129-8b47-4dd0-9478-23d8992b77d7 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:39:01.086892 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-4bd1d685-6748-4fc4-b4e7-708828425e99 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:01.087768 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-4bd1d685-6748-4fc4-b4e7-708828425e99 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:01.095452 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4bd1d685-6748-4fc4-b4e7-708828425e99 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:01.096064 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4bd1d685-6748-4fc4-b4e7-708828425e99 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:01.096492 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4bd1d685-6748-4fc4-b4e7-708828425e99 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:01.097441 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4bd1d685-6748-4fc4-b4e7-708828425e99 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:01.098110 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4bd1d685-6748-4fc4-b4e7-708828425e99 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:01.098570 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4bd1d685-6748-4fc4-b4e7-708828425e99 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:01.235045 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-4bd1d685-6748-4fc4-b4e7-708828425e99 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:01.243399 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-4bd1d685-6748-4fc4-b4e7-708828425e99 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1522 microversion: 2.1 time: 0.161229 Aug 10 13:39:01.243970 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 96/167] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:01 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:39:01.701688 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-9dca17be-65fc-4660-9a0c-4a59db3d03fb tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] Calling method '.version_select at 0x7f49c477a5e0>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:01.727448 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.wsgi [None req-9dca17be-65fc-4660-9a0c-4a59db3d03fb tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] HTTP exception thrown: Snapshot 8796f129-8b47-4dd0-9478-23d8992b77d7 could not be found. Aug 10 13:39:01.729796 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-9dca17be-65fc-4660-9a0c-4a59db3d03fb tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] Request method failure captured: Aug 10 13:39:01.729796 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: request: GET /compute/v2.1/os-snapshots/8796f129-8b47-4dd0-9478-23d8992b77d7 HTTP/1.1 Aug 10 13:39:01.729796 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept: application/json Aug 10 13:39:01.729796 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept-Encoding: identity Aug 10 13:39:01.729796 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Connection: close Aug 10 13:39:01.729796 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Length: 0 Aug 10 13:39:01.729796 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Type: application/json Aug 10 13:39:01.729796 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Host: 10.222.0.52 Aug 10 13:39:01.729796 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Openstack-System-Scope: None Aug 10 13:39:01.729796 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: User-Agent: python-urllib3/1.26.11 Aug 10 13:39:01.729796 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Auth-Token: gAAAAABi87TuyrkgiI4mBfwDq2sbcthzid-Qjwr_XKfpc5VVl8VInuRYLoaxvTCeS2JHNmaN2JrvEx_x36Ymu5HIj6k5qiAtnsqSMdsfsc9_JdrYbTUXK7-B2lx5Pn61fUnVsz3I9SJsNqQl8WvvaqZBiZ2e9YzoURGU95ddclGu9bSWZySe1-E Aug 10 13:39:01.729796 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Id: None Aug 10 13:39:01.729796 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Name: None Aug 10 13:39:01.729796 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Identity-Status: Confirmed Aug 10 13:39:01.729796 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Is-Admin-Project: True Aug 10 13:39:01.729796 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Id: default Aug 10 13:39:01.729796 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Name: Default Aug 10 13:39:01.729796 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Id: 9aa8759e166c497d9fdba8e566fd98ec Aug 10 13:39:01.729796 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-679930455 Aug 10 13:39:01.729796 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Role: member,reader Aug 10 13:39:01.729796 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Roles: member,reader Aug 10 13:39:01.731180 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9aa8759e166c497d9fdba8e566fd98ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9aa8759e166c497d9fdba8e566fd98ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9aa8759e166c497d9fdba8e566fd98ec", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9aa8759e166c497d9fdba8e566fd98ec"}]}] Aug 10 13:39:01.731180 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant: tempest-VolumesSnapshotsTestJSON-679930455 Aug 10 13:39:01.731180 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Id: 9aa8759e166c497d9fdba8e566fd98ec Aug 10 13:39:01.731180 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-679930455 Aug 10 13:39:01.731180 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User: tempest-VolumesSnapshotsTestJSON-679930455-project Aug 10 13:39:01.731180 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Id: default Aug 10 13:39:01.731180 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Name: Default Aug 10 13:39:01.731180 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Id: f36fd12e187d495bae90c61d17227ac3 Aug 10 13:39:01.731180 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Name: tempest-VolumesSnapshotsTestJSON-679930455-project Aug 10 13:39:01.731180 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: method: Aug 10 13:39:01.731180 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: exception: Snapshot 8796f129-8b47-4dd0-9478-23d8992b77d7 could not be found. Aug 10 13:39:01.731180 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: action_args: {'id': '8796f129-8b47-4dd0-9478-23d8992b77d7'} Aug 10 13:39:01.731180 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:39:01.731966 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:39:01.731966 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 10 13:39:01.731966 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 10 13:39:01.731966 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 10 13:39:01.731966 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 10 13:39:01.731966 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 10 13:39:01.731966 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 10 13:39:01.731966 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 13:39:01.731966 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 13:39:01.731966 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 13:39:01.731966 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 13:39:01.731966 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 13:39:01.731966 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 13:39:01.731966 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 13:39:01.731966 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 13:39:01.731966 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 8796f129-8b47-4dd0-9478-23d8992b77d7 could not be found. (HTTP 404) (Request-ID: req-0ba2398f-8bc9-4d8f-95c7-bddb608238cc) Aug 10 13:39:01.731966 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:39:01.731966 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:39:01.733078 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:39:01.733078 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:39:01.733078 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 10 13:39:01.733078 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 10 13:39:01.733078 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 13:39:01.733078 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 13:39:01.733078 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 10 13:39:01.733078 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 10 13:39:01.733078 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 13:39:01.733078 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 13:39:01.733078 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 10 13:39:01.733078 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 10 13:39:01.733078 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 10 13:39:01.733078 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 10 13:39:01.733078 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 10 13:39:01.733078 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 10 13:39:01.733078 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 13:39:01.733078 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 13:39:01.733078 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 13:39:01.734285 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 13:39:01.734285 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 13:39:01.734285 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 13:39:01.734285 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 13:39:01.734285 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 13:39:01.734285 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 8796f129-8b47-4dd0-9478-23d8992b77d7 could not be found. Aug 10 13:39:01.734285 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:39:01.734285 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:39:01.734285 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:39:01.734285 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:39:01.734285 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:39:01.734285 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:39:01.734285 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:39:01.734285 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:39:01.734285 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 13:39:01.734285 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 13:39:01.734285 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:39:01.734285 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:39:01.734285 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 10 13:39:01.734285 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:39:01.735460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 8796f129-8b47-4dd0-9478-23d8992b77d7 could not be found. Aug 10 13:39:01.735460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:39:01.735460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:39:01.735460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:39:01.735460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:39:01.735460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:39:01.735460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:39:01.735460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:39:01.735460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:39:01.735460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 8796f129-8b47-4dd0-9478-23d8992b77d7 could not be found. Aug 10 13:39:01.735460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:39:01.735460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-9dca17be-65fc-4660-9a0c-4a59db3d03fb tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] Returning 404 to user: Snapshot 8796f129-8b47-4dd0-9478-23d8992b77d7 could not be found. {{(pid=129523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:39:01.735460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-9dca17be-65fc-4660-9a0c-4a59db3d03fb tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/8796f129-8b47-4dd0-9478-23d8992b77d7" status: 404 len: 111 microversion: 2.1 time: 0.033622 Aug 10 13:39:01.735460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 72/168] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Aug 10 13:39:01 2022] GET /compute/v2.1/os-snapshots/8796f129-8b47-4dd0-9478-23d8992b77d7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:39:01.740658 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-1dc5b2f6-ca3c-4c3a-8c0e-92e853fe82f6 tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] Calling method '.version_select at 0x7f49c47b8dc0>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:01.823131 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-1dc5b2f6-ca3c-4c3a-8c0e-92e853fe82f6 tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e" status: 202 len: 0 microversion: 2.1 time: 0.086663 Aug 10 13:39:01.823851 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 97/169] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Aug 10 13:39:01 2022] DELETE /compute/v2.1/os-volumes/a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 13:39:01.832385 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-6ef4556e-0b38-4ff3-a6b7-8bfe0ccaeea7 tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] Calling method '.version_select at 0x7f49c5b323a0>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:01.883266 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-6ef4556e-0b38-4ff3-a6b7-8bfe0ccaeea7 tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e" status: 200 len: 345 microversion: 2.1 time: 0.055171 Aug 10 13:39:01.883822 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 73/170] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 10 13:39:01 2022] GET /compute/v2.1/os-volumes/a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:39:02.266326 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-2c0cc3b5-4c37-47cb-9682-963acec800dd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:02.266944 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-2c0cc3b5-4c37-47cb-9682-963acec800dd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:02.273864 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2c0cc3b5-4c37-47cb-9682-963acec800dd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:02.274361 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2c0cc3b5-4c37-47cb-9682-963acec800dd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:02.274832 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2c0cc3b5-4c37-47cb-9682-963acec800dd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:02.275578 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2c0cc3b5-4c37-47cb-9682-963acec800dd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:02.276114 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2c0cc3b5-4c37-47cb-9682-963acec800dd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:02.276538 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2c0cc3b5-4c37-47cb-9682-963acec800dd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:02.620783 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-2c0cc3b5-4c37-47cb-9682-963acec800dd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:02.629008 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-2c0cc3b5-4c37-47cb-9682-963acec800dd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1522 microversion: 2.1 time: 0.367242 Aug 10 13:39:02.629630 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 98/171] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:02 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1522 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:02.898041 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-9882d028-2e90-4636-971b-15cdef6f0788 tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] Calling method '.version_select at 0x7f49c477a040>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:02.929348 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.wsgi [None req-9882d028-2e90-4636-971b-15cdef6f0788 tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] HTTP exception thrown: Volume a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e could not be found. Aug 10 13:39:02.931363 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-9882d028-2e90-4636-971b-15cdef6f0788 tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] Request method failure captured: Aug 10 13:39:02.931363 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: request: GET /compute/v2.1/os-volumes/a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e HTTP/1.1 Aug 10 13:39:02.931363 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept: application/json Aug 10 13:39:02.931363 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept-Encoding: identity Aug 10 13:39:02.931363 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Connection: close Aug 10 13:39:02.931363 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Length: 0 Aug 10 13:39:02.931363 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Type: application/json Aug 10 13:39:02.931363 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Host: 10.222.0.52 Aug 10 13:39:02.931363 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Openstack-System-Scope: None Aug 10 13:39:02.931363 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: User-Agent: python-urllib3/1.26.11 Aug 10 13:39:02.931363 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Auth-Token: gAAAAABi87TuyrkgiI4mBfwDq2sbcthzid-Qjwr_XKfpc5VVl8VInuRYLoaxvTCeS2JHNmaN2JrvEx_x36Ymu5HIj6k5qiAtnsqSMdsfsc9_JdrYbTUXK7-B2lx5Pn61fUnVsz3I9SJsNqQl8WvvaqZBiZ2e9YzoURGU95ddclGu9bSWZySe1-E Aug 10 13:39:02.931363 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Id: None Aug 10 13:39:02.931363 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Name: None Aug 10 13:39:02.931363 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Identity-Status: Confirmed Aug 10 13:39:02.931363 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Is-Admin-Project: True Aug 10 13:39:02.931363 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Id: default Aug 10 13:39:02.931363 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Name: Default Aug 10 13:39:02.931363 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Id: 9aa8759e166c497d9fdba8e566fd98ec Aug 10 13:39:02.931363 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-679930455 Aug 10 13:39:02.931363 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Role: member,reader Aug 10 13:39:02.931363 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Roles: member,reader Aug 10 13:39:02.932940 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9aa8759e166c497d9fdba8e566fd98ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9aa8759e166c497d9fdba8e566fd98ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9aa8759e166c497d9fdba8e566fd98ec", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9aa8759e166c497d9fdba8e566fd98ec"}]}] Aug 10 13:39:02.932940 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant: tempest-VolumesSnapshotsTestJSON-679930455 Aug 10 13:39:02.932940 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Id: 9aa8759e166c497d9fdba8e566fd98ec Aug 10 13:39:02.932940 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-679930455 Aug 10 13:39:02.932940 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User: tempest-VolumesSnapshotsTestJSON-679930455-project Aug 10 13:39:02.932940 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Id: default Aug 10 13:39:02.932940 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Name: Default Aug 10 13:39:02.932940 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Id: f36fd12e187d495bae90c61d17227ac3 Aug 10 13:39:02.932940 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Name: tempest-VolumesSnapshotsTestJSON-679930455-project Aug 10 13:39:02.932940 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: method: Aug 10 13:39:02.932940 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: exception: Volume a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e could not be found. Aug 10 13:39:02.932940 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: action_args: {'id': 'a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e'} Aug 10 13:39:02.932940 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:39:02.934094 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:39:02.934094 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 13:39:02.934094 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 13:39:02.934094 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 13:39:02.934094 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 13:39:02.934094 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 13:39:02.934094 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 13:39:02.934094 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 13:39:02.934094 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 13:39:02.934094 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 13:39:02.934094 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 13:39:02.934094 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 13:39:02.934094 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 13:39:02.934094 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 13:39:02.934094 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 13:39:02.934094 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e could not be found. (HTTP 404) (Request-ID: req-a6ef1025-99e2-4001-ab85-f8a6988f3818) Aug 10 13:39:02.934094 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:39:02.934094 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:39:02.934094 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:39:02.935169 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:39:02.935169 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 13:39:02.935169 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 13:39:02.935169 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 13:39:02.935169 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 13:39:02.935169 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 13:39:02.935169 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 13:39:02.935169 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 13:39:02.935169 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 13:39:02.935169 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 13:39:02.935169 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 13:39:02.935169 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 13:39:02.935169 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 13:39:02.935169 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 13:39:02.935169 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 13:39:02.935169 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 13:39:02.935169 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 13:39:02.935169 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 13:39:02.935169 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 13:39:02.936405 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 13:39:02.936405 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 13:39:02.936405 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 13:39:02.936405 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 13:39:02.936405 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e could not be found. Aug 10 13:39:02.936405 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:39:02.936405 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:39:02.936405 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:39:02.936405 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:39:02.936405 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:39:02.936405 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:39:02.936405 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:39:02.936405 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:39:02.936405 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 13:39:02.936405 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 13:39:02.936405 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:39:02.936405 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:39:02.936405 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 13:39:02.936405 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:39:02.937710 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e could not be found. Aug 10 13:39:02.937710 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:39:02.937710 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:39:02.937710 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:39:02.937710 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:39:02.937710 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:39:02.937710 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:39:02.937710 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:39:02.937710 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:39:02.937710 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e could not be found. Aug 10 13:39:02.937710 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:39:02.937710 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-9882d028-2e90-4636-971b-15cdef6f0788 tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] Returning 404 to user: Volume a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e could not be found. {{(pid=129523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:39:02.937710 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-9882d028-2e90-4636-971b-15cdef6f0788 tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e" status: 404 len: 109 microversion: 2.1 time: 0.039457 Aug 10 13:39:02.937710 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 74/172] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 10 13:39:02 2022] GET /compute/v2.1/os-volumes/a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:39:02.945692 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-493727f1-980b-47db-b330-ee94cdc68d10 tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] Calling method '.version_select at 0x7f49c47b8c10>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:02.975542 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.wsgi [None req-493727f1-980b-47db-b330-ee94cdc68d10 tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] HTTP exception thrown: Volume a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e could not be found. Aug 10 13:39:02.977592 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-493727f1-980b-47db-b330-ee94cdc68d10 tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] Request method failure captured: Aug 10 13:39:02.977592 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: request: DELETE /compute/v2.1/os-volumes/a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e HTTP/1.1 Aug 10 13:39:02.977592 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept: application/json Aug 10 13:39:02.977592 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept-Encoding: identity Aug 10 13:39:02.977592 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Connection: close Aug 10 13:39:02.977592 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Length: 0 Aug 10 13:39:02.977592 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Type: application/json Aug 10 13:39:02.977592 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Host: 10.222.0.52 Aug 10 13:39:02.977592 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Openstack-System-Scope: None Aug 10 13:39:02.977592 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: User-Agent: python-urllib3/1.26.11 Aug 10 13:39:02.977592 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Auth-Token: gAAAAABi87TuyrkgiI4mBfwDq2sbcthzid-Qjwr_XKfpc5VVl8VInuRYLoaxvTCeS2JHNmaN2JrvEx_x36Ymu5HIj6k5qiAtnsqSMdsfsc9_JdrYbTUXK7-B2lx5Pn61fUnVsz3I9SJsNqQl8WvvaqZBiZ2e9YzoURGU95ddclGu9bSWZySe1-E Aug 10 13:39:02.977592 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Id: None Aug 10 13:39:02.977592 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Name: None Aug 10 13:39:02.977592 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Identity-Status: Confirmed Aug 10 13:39:02.977592 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Is-Admin-Project: True Aug 10 13:39:02.977592 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Id: default Aug 10 13:39:02.977592 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Name: Default Aug 10 13:39:02.977592 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Id: 9aa8759e166c497d9fdba8e566fd98ec Aug 10 13:39:02.977592 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-679930455 Aug 10 13:39:02.977592 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Role: member,reader Aug 10 13:39:02.977592 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Roles: member,reader Aug 10 13:39:02.978949 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9aa8759e166c497d9fdba8e566fd98ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9aa8759e166c497d9fdba8e566fd98ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9aa8759e166c497d9fdba8e566fd98ec", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9aa8759e166c497d9fdba8e566fd98ec"}]}] Aug 10 13:39:02.978949 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant: tempest-VolumesSnapshotsTestJSON-679930455 Aug 10 13:39:02.978949 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Id: 9aa8759e166c497d9fdba8e566fd98ec Aug 10 13:39:02.978949 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-679930455 Aug 10 13:39:02.978949 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User: tempest-VolumesSnapshotsTestJSON-679930455-project Aug 10 13:39:02.978949 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Id: default Aug 10 13:39:02.978949 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Name: Default Aug 10 13:39:02.978949 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Id: f36fd12e187d495bae90c61d17227ac3 Aug 10 13:39:02.978949 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Name: tempest-VolumesSnapshotsTestJSON-679930455-project Aug 10 13:39:02.978949 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: method: Aug 10 13:39:02.978949 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: exception: Volume a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e could not be found. Aug 10 13:39:02.978949 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: action_args: {'id': 'a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e'} Aug 10 13:39:02.978949 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:39:02.979813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:39:02.979813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 13:39:02.979813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 13:39:02.979813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 13:39:02.979813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 13:39:02.979813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 13:39:02.979813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 13:39:02.979813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 13:39:02.979813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 13:39:02.979813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 13:39:02.979813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 13:39:02.979813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 13:39:02.979813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 13:39:02.979813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 13:39:02.979813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 13:39:02.979813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e could not be found. (HTTP 404) (Request-ID: req-60b9ddff-ee29-4d50-842f-8fe823f41dd3) Aug 10 13:39:02.979813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:39:02.979813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:39:02.979813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:39:02.981420 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:39:02.981420 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 13:39:02.981420 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 13:39:02.981420 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 13:39:02.981420 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 13:39:02.981420 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 13:39:02.981420 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 13:39:02.981420 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 13:39:02.981420 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 13:39:02.981420 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 13:39:02.981420 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 13:39:02.981420 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 13:39:02.981420 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 13:39:02.981420 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 13:39:02.981420 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 13:39:02.981420 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 13:39:02.981420 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 13:39:02.981420 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 13:39:02.981420 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 13:39:02.982632 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 13:39:02.982632 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 13:39:02.982632 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 13:39:02.982632 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 13:39:02.982632 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e could not be found. Aug 10 13:39:02.982632 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:39:02.982632 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:39:02.982632 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:39:02.982632 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:39:02.982632 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:39:02.982632 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:39:02.982632 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:39:02.982632 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:39:02.982632 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 13:39:02.982632 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 13:39:02.982632 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:39:02.982632 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:39:02.982632 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 13:39:02.982632 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:39:02.983811 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e could not be found. Aug 10 13:39:02.983811 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:39:02.983811 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:39:02.983811 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:39:02.983811 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:39:02.983811 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:39:02.983811 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:39:02.983811 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:39:02.983811 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:39:02.983811 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e could not be found. Aug 10 13:39:02.983811 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:39:02.983811 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-493727f1-980b-47db-b330-ee94cdc68d10 tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] Returning 404 to user: Volume a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e could not be found. {{(pid=129522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:39:02.983811 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-493727f1-980b-47db-b330-ee94cdc68d10 tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e" status: 404 len: 109 microversion: 2.1 time: 0.037225 Aug 10 13:39:02.983811 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 99/173] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Aug 10 13:39:02 2022] DELETE /compute/v2.1/os-volumes/a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:39:02.989656 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-73ddab31-e53b-4771-8278-72a5c100f175 tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] Calling method '.version_select at 0x7f49c477adc0>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:03.019117 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.wsgi [None req-73ddab31-e53b-4771-8278-72a5c100f175 tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] HTTP exception thrown: Volume a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e could not be found. Aug 10 13:39:03.021852 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-73ddab31-e53b-4771-8278-72a5c100f175 tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] Request method failure captured: Aug 10 13:39:03.021852 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: request: GET /compute/v2.1/os-volumes/a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e HTTP/1.1 Aug 10 13:39:03.021852 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept: application/json Aug 10 13:39:03.021852 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept-Encoding: identity Aug 10 13:39:03.021852 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Connection: close Aug 10 13:39:03.021852 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Length: 0 Aug 10 13:39:03.021852 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Type: application/json Aug 10 13:39:03.021852 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Host: 10.222.0.52 Aug 10 13:39:03.021852 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Openstack-System-Scope: None Aug 10 13:39:03.021852 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: User-Agent: python-urllib3/1.26.11 Aug 10 13:39:03.021852 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Auth-Token: gAAAAABi87TuyrkgiI4mBfwDq2sbcthzid-Qjwr_XKfpc5VVl8VInuRYLoaxvTCeS2JHNmaN2JrvEx_x36Ymu5HIj6k5qiAtnsqSMdsfsc9_JdrYbTUXK7-B2lx5Pn61fUnVsz3I9SJsNqQl8WvvaqZBiZ2e9YzoURGU95ddclGu9bSWZySe1-E Aug 10 13:39:03.021852 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Id: None Aug 10 13:39:03.021852 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Name: None Aug 10 13:39:03.021852 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Identity-Status: Confirmed Aug 10 13:39:03.021852 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Is-Admin-Project: True Aug 10 13:39:03.021852 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Id: default Aug 10 13:39:03.021852 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Name: Default Aug 10 13:39:03.021852 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Id: 9aa8759e166c497d9fdba8e566fd98ec Aug 10 13:39:03.021852 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-679930455 Aug 10 13:39:03.021852 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Role: member,reader Aug 10 13:39:03.021852 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Roles: member,reader Aug 10 13:39:03.024209 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9aa8759e166c497d9fdba8e566fd98ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9aa8759e166c497d9fdba8e566fd98ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9aa8759e166c497d9fdba8e566fd98ec", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9aa8759e166c497d9fdba8e566fd98ec"}]}] Aug 10 13:39:03.024209 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant: tempest-VolumesSnapshotsTestJSON-679930455 Aug 10 13:39:03.024209 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Id: 9aa8759e166c497d9fdba8e566fd98ec Aug 10 13:39:03.024209 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-679930455 Aug 10 13:39:03.024209 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User: tempest-VolumesSnapshotsTestJSON-679930455-project Aug 10 13:39:03.024209 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Id: default Aug 10 13:39:03.024209 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Name: Default Aug 10 13:39:03.024209 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Id: f36fd12e187d495bae90c61d17227ac3 Aug 10 13:39:03.024209 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Name: tempest-VolumesSnapshotsTestJSON-679930455-project Aug 10 13:39:03.024209 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: method: Aug 10 13:39:03.024209 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: exception: Volume a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e could not be found. Aug 10 13:39:03.024209 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: action_args: {'id': 'a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e'} Aug 10 13:39:03.024209 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:39:03.024920 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:39:03.024920 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 13:39:03.024920 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 13:39:03.024920 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 13:39:03.024920 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 13:39:03.024920 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 13:39:03.024920 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 13:39:03.024920 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 13:39:03.024920 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 13:39:03.024920 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 13:39:03.024920 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 13:39:03.024920 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 13:39:03.024920 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 13:39:03.024920 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 13:39:03.024920 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 13:39:03.024920 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e could not be found. (HTTP 404) (Request-ID: req-32960d8f-a775-4faf-acbd-978f8dac4792) Aug 10 13:39:03.024920 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:39:03.024920 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:39:03.024920 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:39:03.026347 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:39:03.026347 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 13:39:03.026347 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 13:39:03.026347 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 13:39:03.026347 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 13:39:03.026347 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 13:39:03.026347 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 13:39:03.026347 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 13:39:03.026347 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 13:39:03.026347 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 13:39:03.026347 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 13:39:03.026347 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 13:39:03.026347 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 13:39:03.026347 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 13:39:03.026347 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 13:39:03.026347 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 13:39:03.026347 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 13:39:03.026347 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 13:39:03.026347 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 13:39:03.027591 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 13:39:03.027591 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 13:39:03.027591 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 13:39:03.027591 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 13:39:03.027591 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e could not be found. Aug 10 13:39:03.027591 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:39:03.027591 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:39:03.027591 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:39:03.027591 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:39:03.027591 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:39:03.027591 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:39:03.027591 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:39:03.027591 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:39:03.027591 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 13:39:03.027591 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 13:39:03.027591 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:39:03.027591 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:39:03.027591 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 13:39:03.027591 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:39:03.031242 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e could not be found. Aug 10 13:39:03.031242 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:39:03.031242 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:39:03.031242 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:39:03.031242 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:39:03.031242 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:39:03.031242 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:39:03.031242 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:39:03.031242 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:39:03.031242 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e could not be found. Aug 10 13:39:03.031242 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:39:03.031242 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-73ddab31-e53b-4771-8278-72a5c100f175 tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] Returning 404 to user: Volume a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e could not be found. {{(pid=129523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:39:03.031242 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-73ddab31-e53b-4771-8278-72a5c100f175 tempest-VolumesSnapshotsTestJSON-679930455 tempest-VolumesSnapshotsTestJSON-679930455-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e" status: 404 len: 109 microversion: 2.1 time: 0.038027 Aug 10 13:39:03.031242 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 75/174] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 10 13:39:02 2022] GET /compute/v2.1/os-volumes/a5c24ee9-eb82-4cfd-a67c-ed0b8707bb1e => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:39:03.651210 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-941fb627-6183-40ff-bf1e-22023aef437e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:03.652600 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-941fb627-6183-40ff-bf1e-22023aef437e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:03.660498 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-941fb627-6183-40ff-bf1e-22023aef437e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:03.661318 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-941fb627-6183-40ff-bf1e-22023aef437e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:03.662381 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-941fb627-6183-40ff-bf1e-22023aef437e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:03.663882 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-941fb627-6183-40ff-bf1e-22023aef437e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:03.664532 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-941fb627-6183-40ff-bf1e-22023aef437e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:03.664951 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-941fb627-6183-40ff-bf1e-22023aef437e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:03.820876 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-941fb627-6183-40ff-bf1e-22023aef437e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:03.843287 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-941fb627-6183-40ff-bf1e-22023aef437e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1522 microversion: 2.1 time: 0.192158 Aug 10 13:39:03.865468 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 100/175] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:03 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:04.650003 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-f7d9d918-884a-453d-9a16-f6360e8008fe tempest-VolumesGetTestJSON-2088804282 tempest-VolumesGetTestJSON-2088804282-project] Action: 'create', calling method: .version_select at 0x7f49c477a670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1641378377", "metadata": {"Type": "work"}}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:39:04.864575 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-21ee7b3b-1ca8-4861-81d8-d93dc74b33b8 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:04.865962 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-21ee7b3b-1ca8-4861-81d8-d93dc74b33b8 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:04.879816 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-21ee7b3b-1ca8-4861-81d8-d93dc74b33b8 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:04.880478 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-21ee7b3b-1ca8-4861-81d8-d93dc74b33b8 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:04.881103 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-21ee7b3b-1ca8-4861-81d8-d93dc74b33b8 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:04.881980 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-21ee7b3b-1ca8-4861-81d8-d93dc74b33b8 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:04.882659 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-21ee7b3b-1ca8-4861-81d8-d93dc74b33b8 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:04.882901 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-21ee7b3b-1ca8-4861-81d8-d93dc74b33b8 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:04.987114 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-f7d9d918-884a-453d-9a16-f6360e8008fe tempest-VolumesGetTestJSON-2088804282 tempest-VolumesGetTestJSON-2088804282-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.454362 Aug 10 13:39:04.988023 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 76/176] 10.222.0.52 () {60 vars in 1156 bytes} [Wed Aug 10 13:39:04 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 456 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 10 13:39:05.000426 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-798778fd-b05e-4610-8377-36362846e9cf tempest-VolumesGetTestJSON-2088804282 tempest-VolumesGetTestJSON-2088804282-project] Calling method '.version_select at 0x7f49c47c7820>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:05.062440 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-798778fd-b05e-4610-8377-36362846e9cf tempest-VolumesGetTestJSON-2088804282 tempest-VolumesGetTestJSON-2088804282-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/facd477d-0a7c-4ee7-9236-a59122f05833" status: 200 len: 353 microversion: 2.1 time: 0.065739 Aug 10 13:39:05.063004 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 77/177] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 10 13:39:04 2022] GET /compute/v2.1/os-volumes/facd477d-0a7c-4ee7-9236-a59122f05833 => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:39:05.073877 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-21ee7b3b-1ca8-4861-81d8-d93dc74b33b8 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:05.081363 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-21ee7b3b-1ca8-4861-81d8-d93dc74b33b8 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1522 microversion: 2.1 time: 0.220854 Aug 10 13:39:05.081926 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 101/178] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:04 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:39:06.072789 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_api:SELECT=17 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:39:06.073583 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell1:SELECT=43 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:39:06.077676 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-644f5a84-544a-44b8-ae06-0ffa0a6969e0 tempest-VolumesGetTestJSON-2088804282 tempest-VolumesGetTestJSON-2088804282-project] Calling method '.version_select at 0x7f49c49daa60>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:06.107736 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-d8cfa2e1-36f1-4933-acf2-2acc75e3a402 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:06.108504 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-d8cfa2e1-36f1-4933-acf2-2acc75e3a402 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:06.119445 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d8cfa2e1-36f1-4933-acf2-2acc75e3a402 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:06.120536 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d8cfa2e1-36f1-4933-acf2-2acc75e3a402 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:06.121823 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d8cfa2e1-36f1-4933-acf2-2acc75e3a402 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:06.123551 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d8cfa2e1-36f1-4933-acf2-2acc75e3a402 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:06.124604 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d8cfa2e1-36f1-4933-acf2-2acc75e3a402 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:06.125391 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d8cfa2e1-36f1-4933-acf2-2acc75e3a402 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:06.148691 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-644f5a84-544a-44b8-ae06-0ffa0a6969e0 tempest-VolumesGetTestJSON-2088804282 tempest-VolumesGetTestJSON-2088804282-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/facd477d-0a7c-4ee7-9236-a59122f05833" status: 200 len: 354 microversion: 2.1 time: 0.076593 Aug 10 13:39:06.149282 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 78/179] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 10 13:39:06 2022] GET /compute/v2.1/os-volumes/facd477d-0a7c-4ee7-9236-a59122f05833 => generated 354 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:39:06.161466 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-c2ec37b2-268f-472d-825b-202711364e98 tempest-VolumesGetTestJSON-2088804282 tempest-VolumesGetTestJSON-2088804282-project] Calling method '.version_select at 0x7f49c477a0d0>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:06.212459 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-c2ec37b2-268f-472d-825b-202711364e98 tempest-VolumesGetTestJSON-2088804282 tempest-VolumesGetTestJSON-2088804282-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/facd477d-0a7c-4ee7-9236-a59122f05833" status: 200 len: 354 microversion: 2.1 time: 0.054773 Aug 10 13:39:06.213027 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 79/180] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 10 13:39:06 2022] GET /compute/v2.1/os-volumes/facd477d-0a7c-4ee7-9236-a59122f05833 => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:39:06.230665 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-839920e2-5c91-4eef-ae15-1645e915818c tempest-VolumesGetTestJSON-2088804282 tempest-VolumesGetTestJSON-2088804282-project] Calling method '.version_select at 0x7f49c47bcaf0>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:06.277924 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-d8cfa2e1-36f1-4933-acf2-2acc75e3a402 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:06.286054 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-d8cfa2e1-36f1-4933-acf2-2acc75e3a402 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1522 microversion: 2.1 time: 0.182486 Aug 10 13:39:06.286623 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 102/181] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:06 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:06.303438 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-839920e2-5c91-4eef-ae15-1645e915818c tempest-VolumesGetTestJSON-2088804282 tempest-VolumesGetTestJSON-2088804282-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/facd477d-0a7c-4ee7-9236-a59122f05833" status: 202 len: 0 microversion: 2.1 time: 0.075219 Aug 10 13:39:06.304170 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 80/182] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Aug 10 13:39:06 2022] DELETE /compute/v2.1/os-volumes/facd477d-0a7c-4ee7-9236-a59122f05833 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 13:39:06.312725 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-9b946624-e528-404c-84d1-65ba3e1c391b tempest-VolumesGetTestJSON-2088804282 tempest-VolumesGetTestJSON-2088804282-project] Calling method '.version_select at 0x7f49c47d6160>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:06.358924 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-9b946624-e528-404c-84d1-65ba3e1c391b tempest-VolumesGetTestJSON-2088804282 tempest-VolumesGetTestJSON-2088804282-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/facd477d-0a7c-4ee7-9236-a59122f05833" status: 200 len: 353 microversion: 2.1 time: 0.050047 Aug 10 13:39:06.359499 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 103/183] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 10 13:39:06 2022] GET /compute/v2.1/os-volumes/facd477d-0a7c-4ee7-9236-a59122f05833 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:39:07.310633 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-d93fe170-b7ba-41ad-ab26-c34004caa4e1 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:07.311239 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-d93fe170-b7ba-41ad-ab26-c34004caa4e1 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:07.317503 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d93fe170-b7ba-41ad-ab26-c34004caa4e1 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:07.317981 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d93fe170-b7ba-41ad-ab26-c34004caa4e1 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:07.318411 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d93fe170-b7ba-41ad-ab26-c34004caa4e1 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:07.319086 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d93fe170-b7ba-41ad-ab26-c34004caa4e1 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:07.319533 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d93fe170-b7ba-41ad-ab26-c34004caa4e1 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:07.319948 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d93fe170-b7ba-41ad-ab26-c34004caa4e1 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:07.374149 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-6dd376b6-c21f-42ce-9707-4403c6b8521b tempest-VolumesGetTestJSON-2088804282 tempest-VolumesGetTestJSON-2088804282-project] Calling method '.version_select at 0x7f49c47f1550>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:07.420571 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-6dd376b6-c21f-42ce-9707-4403c6b8521b tempest-VolumesGetTestJSON-2088804282 tempest-VolumesGetTestJSON-2088804282-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/facd477d-0a7c-4ee7-9236-a59122f05833" status: 200 len: 353 microversion: 2.1 time: 0.050701 Aug 10 13:39:07.421141 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 104/184] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 10 13:39:07 2022] GET /compute/v2.1/os-volumes/facd477d-0a7c-4ee7-9236-a59122f05833 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:39:07.455020 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-d93fe170-b7ba-41ad-ab26-c34004caa4e1 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:07.462942 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-d93fe170-b7ba-41ad-ab26-c34004caa4e1 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1522 microversion: 2.1 time: 0.156060 Aug 10 13:39:07.463504 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 81/185] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:07 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:08.434676 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-88f7c72f-b7eb-41ca-99d8-5635b2fb16a3 tempest-VolumesGetTestJSON-2088804282 tempest-VolumesGetTestJSON-2088804282-project] Calling method '.version_select at 0x7f49c47dc9d0>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:08.480818 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-88f7c72f-b7eb-41ca-99d8-5635b2fb16a3 tempest-VolumesGetTestJSON-2088804282 tempest-VolumesGetTestJSON-2088804282-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/facd477d-0a7c-4ee7-9236-a59122f05833" status: 200 len: 353 microversion: 2.1 time: 0.050257 Aug 10 13:39:08.481543 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 105/186] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 10 13:39:08 2022] GET /compute/v2.1/os-volumes/facd477d-0a7c-4ee7-9236-a59122f05833 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:39:08.483831 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-9af317d9-2b42-4af0-837b-677feffa2d76 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:08.484445 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-9af317d9-2b42-4af0-837b-677feffa2d76 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:08.491363 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9af317d9-2b42-4af0-837b-677feffa2d76 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:08.491868 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9af317d9-2b42-4af0-837b-677feffa2d76 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:08.492303 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9af317d9-2b42-4af0-837b-677feffa2d76 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:08.492987 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9af317d9-2b42-4af0-837b-677feffa2d76 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:08.493467 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9af317d9-2b42-4af0-837b-677feffa2d76 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:08.493890 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9af317d9-2b42-4af0-837b-677feffa2d76 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:08.621043 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-9af317d9-2b42-4af0-837b-677feffa2d76 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:08.628415 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-9af317d9-2b42-4af0-837b-677feffa2d76 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1522 microversion: 2.1 time: 0.148542 Aug 10 13:39:08.628983 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 82/187] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:08 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:39:09.495285 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-2ef3275b-6f11-456f-916d-62e86726469a tempest-VolumesGetTestJSON-2088804282 tempest-VolumesGetTestJSON-2088804282-project] Calling method '.version_select at 0x7f49c47d6820>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:09.546931 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-2ef3275b-6f11-456f-916d-62e86726469a tempest-VolumesGetTestJSON-2088804282 tempest-VolumesGetTestJSON-2088804282-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/facd477d-0a7c-4ee7-9236-a59122f05833" status: 200 len: 353 microversion: 2.1 time: 0.056117 Aug 10 13:39:09.547861 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 106/188] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 10 13:39:09 2022] GET /compute/v2.1/os-volumes/facd477d-0a7c-4ee7-9236-a59122f05833 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:39:09.649432 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-11815142-eaed-4d82-842a-6a5060d81796 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:09.650077 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-11815142-eaed-4d82-842a-6a5060d81796 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:09.656124 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-11815142-eaed-4d82-842a-6a5060d81796 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:09.656609 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-11815142-eaed-4d82-842a-6a5060d81796 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:09.657045 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-11815142-eaed-4d82-842a-6a5060d81796 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:09.657758 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-11815142-eaed-4d82-842a-6a5060d81796 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:09.658219 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-11815142-eaed-4d82-842a-6a5060d81796 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:09.658643 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-11815142-eaed-4d82-842a-6a5060d81796 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:09.790569 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-11815142-eaed-4d82-842a-6a5060d81796 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:09.798330 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-11815142-eaed-4d82-842a-6a5060d81796 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1522 microversion: 2.1 time: 0.153277 Aug 10 13:39:09.798892 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 83/189] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:09 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:10.562050 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-d5641d7e-fbf4-4fa4-a213-6e1e750a2f72 tempest-VolumesGetTestJSON-2088804282 tempest-VolumesGetTestJSON-2088804282-project] Calling method '.version_select at 0x7f49c47f1160>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:10.601801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.wsgi [None req-d5641d7e-fbf4-4fa4-a213-6e1e750a2f72 tempest-VolumesGetTestJSON-2088804282 tempest-VolumesGetTestJSON-2088804282-project] HTTP exception thrown: Volume facd477d-0a7c-4ee7-9236-a59122f05833 could not be found. Aug 10 13:39:10.603807 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-d5641d7e-fbf4-4fa4-a213-6e1e750a2f72 tempest-VolumesGetTestJSON-2088804282 tempest-VolumesGetTestJSON-2088804282-project] Request method failure captured: Aug 10 13:39:10.603807 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: request: GET /compute/v2.1/os-volumes/facd477d-0a7c-4ee7-9236-a59122f05833 HTTP/1.1 Aug 10 13:39:10.603807 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept: application/json Aug 10 13:39:10.603807 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept-Encoding: identity Aug 10 13:39:10.603807 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Connection: close Aug 10 13:39:10.603807 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Length: 0 Aug 10 13:39:10.603807 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Type: application/json Aug 10 13:39:10.603807 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Host: 10.222.0.52 Aug 10 13:39:10.603807 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Openstack-System-Scope: None Aug 10 13:39:10.603807 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: User-Agent: python-urllib3/1.26.11 Aug 10 13:39:10.603807 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Auth-Token: gAAAAABi87T4NYWUwft-YozWoEEscPqyCWsxjgKPC81HZ3UIJp59jXZinxLibPNUzgiFNj2n61CF6MzTVKCK0X-MGnMCd39atvfmfSJwLqat94EOfgKdB_0s75Id2O6jfLT0-2eqtN1yl5dWs1eX4X00Qp_QgtmqavbMa1LUto3z0lPKyNTatzQ Aug 10 13:39:10.603807 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Id: None Aug 10 13:39:10.603807 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Name: None Aug 10 13:39:10.603807 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Identity-Status: Confirmed Aug 10 13:39:10.603807 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Is-Admin-Project: True Aug 10 13:39:10.603807 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Id: default Aug 10 13:39:10.603807 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Name: Default Aug 10 13:39:10.603807 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Id: ec4f4f1bbe6a43b1a7644938a960a4fd Aug 10 13:39:10.603807 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Name: tempest-VolumesGetTestJSON-2088804282 Aug 10 13:39:10.603807 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Role: member,reader Aug 10 13:39:10.603807 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Roles: member,reader Aug 10 13:39:10.605267 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ec4f4f1bbe6a43b1a7644938a960a4fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ec4f4f1bbe6a43b1a7644938a960a4fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ec4f4f1bbe6a43b1a7644938a960a4fd", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ec4f4f1bbe6a43b1a7644938a960a4fd"}]}] Aug 10 13:39:10.605267 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant: tempest-VolumesGetTestJSON-2088804282 Aug 10 13:39:10.605267 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Id: ec4f4f1bbe6a43b1a7644938a960a4fd Aug 10 13:39:10.605267 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Name: tempest-VolumesGetTestJSON-2088804282 Aug 10 13:39:10.605267 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User: tempest-VolumesGetTestJSON-2088804282-project Aug 10 13:39:10.605267 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Id: default Aug 10 13:39:10.605267 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Name: Default Aug 10 13:39:10.605267 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Id: 1e33cb45ee9b4b0ea4c6749caf9dc96f Aug 10 13:39:10.605267 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Name: tempest-VolumesGetTestJSON-2088804282-project Aug 10 13:39:10.605267 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: method: Aug 10 13:39:10.605267 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: exception: Volume facd477d-0a7c-4ee7-9236-a59122f05833 could not be found. Aug 10 13:39:10.605267 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: action_args: {'id': 'facd477d-0a7c-4ee7-9236-a59122f05833'} Aug 10 13:39:10.605267 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:39:10.606242 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:39:10.606242 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 13:39:10.606242 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 13:39:10.606242 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 13:39:10.606242 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 13:39:10.606242 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 13:39:10.606242 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 13:39:10.606242 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 13:39:10.606242 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 13:39:10.606242 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 13:39:10.606242 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 13:39:10.606242 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 13:39:10.606242 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 13:39:10.606242 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 13:39:10.606242 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 13:39:10.606242 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume facd477d-0a7c-4ee7-9236-a59122f05833 could not be found. (HTTP 404) (Request-ID: req-c13a337b-6af7-498b-94f2-13945875dc14) Aug 10 13:39:10.606242 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:39:10.606242 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:39:10.606242 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:39:10.607544 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:39:10.607544 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 13:39:10.607544 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 13:39:10.607544 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 13:39:10.607544 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 13:39:10.607544 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 13:39:10.607544 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 13:39:10.607544 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 13:39:10.607544 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 13:39:10.607544 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 13:39:10.607544 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 13:39:10.607544 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 13:39:10.607544 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 13:39:10.607544 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 13:39:10.607544 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 13:39:10.607544 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 13:39:10.607544 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 13:39:10.607544 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 13:39:10.607544 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 13:39:10.608783 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 13:39:10.608783 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 13:39:10.608783 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 13:39:10.608783 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 13:39:10.608783 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume facd477d-0a7c-4ee7-9236-a59122f05833 could not be found. Aug 10 13:39:10.608783 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:39:10.608783 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:39:10.608783 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:39:10.608783 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:39:10.608783 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:39:10.608783 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:39:10.608783 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:39:10.608783 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:39:10.608783 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 13:39:10.608783 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 13:39:10.608783 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:39:10.608783 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:39:10.608783 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 13:39:10.608783 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:39:10.610055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume facd477d-0a7c-4ee7-9236-a59122f05833 could not be found. Aug 10 13:39:10.610055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:39:10.610055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:39:10.610055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:39:10.610055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:39:10.610055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:39:10.610055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:39:10.610055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:39:10.610055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:39:10.610055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume facd477d-0a7c-4ee7-9236-a59122f05833 could not be found. Aug 10 13:39:10.610055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:39:10.610055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-d5641d7e-fbf4-4fa4-a213-6e1e750a2f72 tempest-VolumesGetTestJSON-2088804282 tempest-VolumesGetTestJSON-2088804282-project] Returning 404 to user: Volume facd477d-0a7c-4ee7-9236-a59122f05833 could not be found. {{(pid=129522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:39:10.610055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-d5641d7e-fbf4-4fa4-a213-6e1e750a2f72 tempest-VolumesGetTestJSON-2088804282 tempest-VolumesGetTestJSON-2088804282-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/facd477d-0a7c-4ee7-9236-a59122f05833" status: 404 len: 109 microversion: 2.1 time: 0.047814 Aug 10 13:39:10.610055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 107/190] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 10 13:39:10 2022] GET /compute/v2.1/os-volumes/facd477d-0a7c-4ee7-9236-a59122f05833 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:39:10.822143 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-cce9ba49-0d33-40dc-8bfb-e4e409ae06c7 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:10.822671 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-cce9ba49-0d33-40dc-8bfb-e4e409ae06c7 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:10.828597 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cce9ba49-0d33-40dc-8bfb-e4e409ae06c7 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:10.829156 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cce9ba49-0d33-40dc-8bfb-e4e409ae06c7 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:10.829747 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cce9ba49-0d33-40dc-8bfb-e4e409ae06c7 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:10.830436 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cce9ba49-0d33-40dc-8bfb-e4e409ae06c7 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:10.830921 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cce9ba49-0d33-40dc-8bfb-e4e409ae06c7 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:10.831450 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cce9ba49-0d33-40dc-8bfb-e4e409ae06c7 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:11.010072 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-cce9ba49-0d33-40dc-8bfb-e4e409ae06c7 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:11.017788 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-cce9ba49-0d33-40dc-8bfb-e4e409ae06c7 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1522 microversion: 2.1 time: 0.199500 Aug 10 13:39:11.018391 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 84/191] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:10 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:12.039966 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-378883e7-ecb0-4b45-9a56-6723c6378b26 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:12.040571 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-378883e7-ecb0-4b45-9a56-6723c6378b26 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:12.042477 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:39:12.047670 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-378883e7-ecb0-4b45-9a56-6723c6378b26 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:12.048157 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-378883e7-ecb0-4b45-9a56-6723c6378b26 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:12.048586 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-378883e7-ecb0-4b45-9a56-6723c6378b26 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:12.049296 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-378883e7-ecb0-4b45-9a56-6723c6378b26 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:12.049747 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-378883e7-ecb0-4b45-9a56-6723c6378b26 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:12.050164 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-378883e7-ecb0-4b45-9a56-6723c6378b26 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:12.195329 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-378883e7-ecb0-4b45-9a56-6723c6378b26 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:12.203020 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-378883e7-ecb0-4b45-9a56-6723c6378b26 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1522 microversion: 2.1 time: 0.168465 Aug 10 13:39:12.203569 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 108/192] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:12 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:13.224812 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-c3b5fabd-49e6-4874-a2be-6a8d3cf87999 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:13.226109 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-c3b5fabd-49e6-4874-a2be-6a8d3cf87999 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:13.232473 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c3b5fabd-49e6-4874-a2be-6a8d3cf87999 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:13.233062 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c3b5fabd-49e6-4874-a2be-6a8d3cf87999 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:13.233759 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c3b5fabd-49e6-4874-a2be-6a8d3cf87999 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:13.234548 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c3b5fabd-49e6-4874-a2be-6a8d3cf87999 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:13.235248 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c3b5fabd-49e6-4874-a2be-6a8d3cf87999 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:13.235769 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c3b5fabd-49e6-4874-a2be-6a8d3cf87999 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:13.384040 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-c3b5fabd-49e6-4874-a2be-6a8d3cf87999 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:13.392567 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-c3b5fabd-49e6-4874-a2be-6a8d3cf87999 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1522 microversion: 2.1 time: 0.171684 Aug 10 13:39:13.393216 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 85/193] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:13 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:14.413655 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-4653fe53-6df3-4608-9fda-c2a4eb3852ed tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:14.414363 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-4653fe53-6df3-4608-9fda-c2a4eb3852ed tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:14.420581 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4653fe53-6df3-4608-9fda-c2a4eb3852ed tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:14.421158 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4653fe53-6df3-4608-9fda-c2a4eb3852ed tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:14.421675 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4653fe53-6df3-4608-9fda-c2a4eb3852ed tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:14.422426 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4653fe53-6df3-4608-9fda-c2a4eb3852ed tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:14.422947 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4653fe53-6df3-4608-9fda-c2a4eb3852ed tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:14.423450 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4653fe53-6df3-4608-9fda-c2a4eb3852ed tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:14.601634 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-4653fe53-6df3-4608-9fda-c2a4eb3852ed tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:14.614624 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-4653fe53-6df3-4608-9fda-c2a4eb3852ed tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1522 microversion: 2.1 time: 0.204669 Aug 10 13:39:14.618197 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 109/194] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:14 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:15.638607 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-f083300e-86ac-4fe3-a7fb-81845c67c734 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:15.639401 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-f083300e-86ac-4fe3-a7fb-81845c67c734 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:15.645672 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f083300e-86ac-4fe3-a7fb-81845c67c734 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:15.646163 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f083300e-86ac-4fe3-a7fb-81845c67c734 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:15.647149 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f083300e-86ac-4fe3-a7fb-81845c67c734 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:15.647905 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f083300e-86ac-4fe3-a7fb-81845c67c734 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:15.648531 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f083300e-86ac-4fe3-a7fb-81845c67c734 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:15.648949 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f083300e-86ac-4fe3-a7fb-81845c67c734 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:15.796675 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-f083300e-86ac-4fe3-a7fb-81845c67c734 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:15.804571 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-f083300e-86ac-4fe3-a7fb-81845c67c734 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1522 microversion: 2.1 time: 0.170584 Aug 10 13:39:15.805129 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 86/195] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:15 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:16.830260 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-f11ef2d6-4306-4f82-8048-4b587275f546 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:16.830260 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-f11ef2d6-4306-4f82-8048-4b587275f546 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:16.835777 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f11ef2d6-4306-4f82-8048-4b587275f546 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:16.836271 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f11ef2d6-4306-4f82-8048-4b587275f546 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:16.836710 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f11ef2d6-4306-4f82-8048-4b587275f546 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:16.837446 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f11ef2d6-4306-4f82-8048-4b587275f546 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:16.837903 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f11ef2d6-4306-4f82-8048-4b587275f546 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:16.838330 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f11ef2d6-4306-4f82-8048-4b587275f546 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:16.987305 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-f11ef2d6-4306-4f82-8048-4b587275f546 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:16.995955 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-f11ef2d6-4306-4f82-8048-4b587275f546 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1522 microversion: 2.1 time: 0.172317 Aug 10 13:39:16.996695 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 110/196] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:16 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:18.018265 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-2ad17d11-2b34-4ebe-a8dc-136750445826 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:18.018882 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-2ad17d11-2b34-4ebe-a8dc-136750445826 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:18.024903 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2ad17d11-2b34-4ebe-a8dc-136750445826 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:18.025489 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2ad17d11-2b34-4ebe-a8dc-136750445826 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:18.025927 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2ad17d11-2b34-4ebe-a8dc-136750445826 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:18.026618 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2ad17d11-2b34-4ebe-a8dc-136750445826 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:18.027069 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2ad17d11-2b34-4ebe-a8dc-136750445826 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:18.027659 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2ad17d11-2b34-4ebe-a8dc-136750445826 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:18.160858 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-2ad17d11-2b34-4ebe-a8dc-136750445826 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:18.169577 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-2ad17d11-2b34-4ebe-a8dc-136750445826 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1502 microversion: 2.1 time: 0.154901 Aug 10 13:39:18.170158 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 87/197] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:18 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:18.189810 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-64e9b5b0-4af7-43cb-aabd-bb868a5b998e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:18.190685 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-64e9b5b0-4af7-43cb-aabd-bb868a5b998e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 9107fc16-6a2c-48ad-8612-964c3ac05c01] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:18.198945 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-64e9b5b0-4af7-43cb-aabd-bb868a5b998e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:18.199429 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-64e9b5b0-4af7-43cb-aabd-bb868a5b998e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:18.199856 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-64e9b5b0-4af7-43cb-aabd-bb868a5b998e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:18.202286 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-64e9b5b0-4af7-43cb-aabd-bb868a5b998e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:18.202286 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-64e9b5b0-4af7-43cb-aabd-bb868a5b998e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:18.202286 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-64e9b5b0-4af7-43cb-aabd-bb868a5b998e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:18.207323 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell1:SELECT=97 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:39:18.382740 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-64e9b5b0-4af7-43cb-aabd-bb868a5b998e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:18.394202 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-64e9b5b0-4af7-43cb-aabd-bb868a5b998e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01" status: 200 len: 1514 microversion: 2.1 time: 0.208310 Aug 10 13:39:18.395347 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 111/198] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:18 2022] GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01 => generated 1514 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:18.598068 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-d55563fd-9e98-4dce-91af-a937ed1cd501 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-627268255", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1990044180", "security_groups": [{"name": "tempest-secgroup-smoke-875459940"}], "block_device_mapping_v2": [{"uuid": "6ea3746d-3af7-4634-b2ee-d1107c0fca2a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0ffcae0f-06e6-4633-8b48-e556a2688783"}]}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:39:18.733617 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.network.neutron [None req-d55563fd-9e98-4dce-91af-a937ed1cd501 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] validate_networks() for [('0ffcae0f-06e6-4633-8b48-e556a2688783', None, None, None, None, None)] {{(pid=129523) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:39:19.224830 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-d55563fd-9e98-4dce-91af-a937ed1cd501 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Flavor limits 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:39:19.225610 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-d55563fd-9e98-4dce-91af-a937ed1cd501 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Image limits 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:39:19.225857 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-d55563fd-9e98-4dce-91af-a937ed1cd501 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Flavor pref 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:39:19.226338 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-d55563fd-9e98-4dce-91af-a937ed1cd501 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Image pref 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:39:19.226754 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-d55563fd-9e98-4dce-91af-a937ed1cd501 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:39:19.238190 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d55563fd-9e98-4dce-91af-a937ed1cd501 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:19.238782 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d55563fd-9e98-4dce-91af-a937ed1cd501 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:19.239539 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d55563fd-9e98-4dce-91af-a937ed1cd501 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:19.240883 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d55563fd-9e98-4dce-91af-a937ed1cd501 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:19.241468 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d55563fd-9e98-4dce-91af-a937ed1cd501 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:19.242080 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d55563fd-9e98-4dce-91af-a937ed1cd501 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:19.259563 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-d55563fd-9e98-4dce-91af-a937ed1cd501 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Getting quotas for project b52f008781f64d09b706d478c8fe8922. Resources: {'cores', 'ram', 'instances'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:39:19.263729 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-d55563fd-9e98-4dce-91af-a937ed1cd501 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Getting quotas for user 411ff3f0306848ee91108343982806ca and project b52f008781f64d09b706d478c8fe8922. Resources: {'cores', 'ram', 'instances'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:39:19.326120 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-d55563fd-9e98-4dce-91af-a937ed1cd501 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Going to run 1 instances... {{(pid=129523) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:39:19.328222 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-d55563fd-9e98-4dce-91af-a937ed1cd501 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 16659e37-a119-4243-8211-1179306997a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6ea3746d-3af7-4634-b2ee-d1107c0fca2a',volume_size=None,volume_type=None)] {{(pid=129523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:39:19.465719 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-d55563fd-9e98-4dce-91af-a937ed1cd501 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.873457 Aug 10 13:39:19.466356 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 88/199] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 10 13:39:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 13:39:19.477021 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-050404ca-7bf7-4034-b712-554f270b3769 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:19.477652 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-050404ca-7bf7-4034-b712-554f270b3769 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 16659e37-a119-4243-8211-1179306997a5] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:19.532347 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-050404ca-7bf7-4034-b712-554f270b3769 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:19.539553 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-050404ca-7bf7-4034-b712-554f270b3769 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5" status: 200 len: 1094 microversion: 2.1 time: 0.066393 Aug 10 13:39:19.540148 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 112/200] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:19 2022] GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:20.559339 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-d70ddef0-3ec1-410b-90f6-8359a18cb19c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:20.559954 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-d70ddef0-3ec1-410b-90f6-8359a18cb19c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 16659e37-a119-4243-8211-1179306997a5] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:20.566393 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d70ddef0-3ec1-410b-90f6-8359a18cb19c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:20.566876 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d70ddef0-3ec1-410b-90f6-8359a18cb19c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:20.567314 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d70ddef0-3ec1-410b-90f6-8359a18cb19c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:20.568508 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d70ddef0-3ec1-410b-90f6-8359a18cb19c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:20.568963 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d70ddef0-3ec1-410b-90f6-8359a18cb19c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:20.569418 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d70ddef0-3ec1-410b-90f6-8359a18cb19c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:20.628448 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-d70ddef0-3ec1-410b-90f6-8359a18cb19c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:20.636608 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-d70ddef0-3ec1-410b-90f6-8359a18cb19c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5" status: 200 len: 1144 microversion: 2.1 time: 0.081127 Aug 10 13:39:20.637164 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 89/201] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:20 2022] GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5 => generated 1144 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:21.657772 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-ada51ba9-0fcf-4d53-a108-b4520ee0434f tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:21.658499 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-ada51ba9-0fcf-4d53-a108-b4520ee0434f tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 16659e37-a119-4243-8211-1179306997a5] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:21.667383 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ada51ba9-0fcf-4d53-a108-b4520ee0434f tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:21.667937 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ada51ba9-0fcf-4d53-a108-b4520ee0434f tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:21.668371 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ada51ba9-0fcf-4d53-a108-b4520ee0434f tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:21.669057 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ada51ba9-0fcf-4d53-a108-b4520ee0434f tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:21.669530 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ada51ba9-0fcf-4d53-a108-b4520ee0434f tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:21.669952 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ada51ba9-0fcf-4d53-a108-b4520ee0434f tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:21.739974 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-ada51ba9-0fcf-4d53-a108-b4520ee0434f tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:21.748271 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-ada51ba9-0fcf-4d53-a108-b4520ee0434f tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5" status: 200 len: 1136 microversion: 2.1 time: 0.094480 Aug 10 13:39:21.749099 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 113/202] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:21 2022] GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5 => generated 1136 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:22.040055 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-3f62f3b6-c9f5-4de9-a07c-ef9357447504 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:39:22.042336 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-3f62f3b6-c9f5-4de9-a07c-ef9357447504 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 9107fc16-6a2c-48ad-8612-964c3ac05c01] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:22.048126 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3f62f3b6-c9f5-4de9-a07c-ef9357447504 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:22.048605 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3f62f3b6-c9f5-4de9-a07c-ef9357447504 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:22.049032 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3f62f3b6-c9f5-4de9-a07c-ef9357447504 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:22.049736 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3f62f3b6-c9f5-4de9-a07c-ef9357447504 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:22.050184 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3f62f3b6-c9f5-4de9-a07c-ef9357447504 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:22.050600 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3f62f3b6-c9f5-4de9-a07c-ef9357447504 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:22.073861 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.objects.instance [None req-3f62f3b6-c9f5-4de9-a07c-ef9357447504 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lazy-loading 'flavor' on Instance uuid 9107fc16-6a2c-48ad-8612-964c3ac05c01 {{(pid=129523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:39:22.145727 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-3f62f3b6-c9f5-4de9-a07c-ef9357447504 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "POST /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01/action" status: 200 len: 32 microversion: 2.1 time: 0.109930 Aug 10 13:39:22.146860 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 90/203] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 10 13:39:22 2022] POST /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01/action => generated 32 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 13:39:22.156329 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-c4fe1639-a6a3-4425-bc18-1ee29d514438 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:22.156945 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-c4fe1639-a6a3-4425-bc18-1ee29d514438 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 9107fc16-6a2c-48ad-8612-964c3ac05c01] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:22.170047 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c4fe1639-a6a3-4425-bc18-1ee29d514438 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:22.170848 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c4fe1639-a6a3-4425-bc18-1ee29d514438 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:22.171297 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c4fe1639-a6a3-4425-bc18-1ee29d514438 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:22.172174 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c4fe1639-a6a3-4425-bc18-1ee29d514438 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:22.172632 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c4fe1639-a6a3-4425-bc18-1ee29d514438 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:22.173060 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c4fe1639-a6a3-4425-bc18-1ee29d514438 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:22.321845 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-c4fe1639-a6a3-4425-bc18-1ee29d514438 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:22.330345 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-c4fe1639-a6a3-4425-bc18-1ee29d514438 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01" status: 200 len: 1520 microversion: 2.1 time: 0.177696 Aug 10 13:39:22.330934 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 114/204] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:22 2022] GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:22.772084 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-ca981d42-84c4-4c71-b2d3-b7e3a12d091e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:22.773053 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-ca981d42-84c4-4c71-b2d3-b7e3a12d091e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 16659e37-a119-4243-8211-1179306997a5] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:22.782387 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ca981d42-84c4-4c71-b2d3-b7e3a12d091e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:22.783095 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ca981d42-84c4-4c71-b2d3-b7e3a12d091e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:22.784700 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ca981d42-84c4-4c71-b2d3-b7e3a12d091e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:22.785874 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ca981d42-84c4-4c71-b2d3-b7e3a12d091e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:22.798209 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ca981d42-84c4-4c71-b2d3-b7e3a12d091e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:22.798954 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ca981d42-84c4-4c71-b2d3-b7e3a12d091e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:22.940881 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-ca981d42-84c4-4c71-b2d3-b7e3a12d091e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:22.955447 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-ca981d42-84c4-4c71-b2d3-b7e3a12d091e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5" status: 200 len: 1210 microversion: 2.1 time: 0.189846 Aug 10 13:39:22.956145 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 91/205] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:22 2022] GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5 => generated 1210 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:23.360596 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-f39bd3ac-2b06-4752-bae9-7dcade74efe2 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:23.362146 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-f39bd3ac-2b06-4752-bae9-7dcade74efe2 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 9107fc16-6a2c-48ad-8612-964c3ac05c01] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:23.374781 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f39bd3ac-2b06-4752-bae9-7dcade74efe2 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:23.376445 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f39bd3ac-2b06-4752-bae9-7dcade74efe2 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:23.377462 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f39bd3ac-2b06-4752-bae9-7dcade74efe2 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:23.379241 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f39bd3ac-2b06-4752-bae9-7dcade74efe2 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:23.380041 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f39bd3ac-2b06-4752-bae9-7dcade74efe2 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:23.381259 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f39bd3ac-2b06-4752-bae9-7dcade74efe2 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:23.543203 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-f39bd3ac-2b06-4752-bae9-7dcade74efe2 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:23.551151 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-f39bd3ac-2b06-4752-bae9-7dcade74efe2 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01" status: 200 len: 1520 microversion: 2.1 time: 0.202360 Aug 10 13:39:23.552090 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 115/206] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:23 2022] GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01 => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:39:23.976543 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-8801fb5e-0cf3-4094-b6d0-1d5183da25b3 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:23.977155 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-8801fb5e-0cf3-4094-b6d0-1d5183da25b3 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 16659e37-a119-4243-8211-1179306997a5] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:23.987446 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8801fb5e-0cf3-4094-b6d0-1d5183da25b3 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:23.988199 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8801fb5e-0cf3-4094-b6d0-1d5183da25b3 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:23.988631 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8801fb5e-0cf3-4094-b6d0-1d5183da25b3 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:23.989366 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8801fb5e-0cf3-4094-b6d0-1d5183da25b3 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:23.990146 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8801fb5e-0cf3-4094-b6d0-1d5183da25b3 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:23.990853 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8801fb5e-0cf3-4094-b6d0-1d5183da25b3 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:24.265748 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-8801fb5e-0cf3-4094-b6d0-1d5183da25b3 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:24.280880 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-8801fb5e-0cf3-4094-b6d0-1d5183da25b3 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5" status: 200 len: 1265 microversion: 2.1 time: 0.308654 Aug 10 13:39:24.293936 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 92/207] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:23 2022] GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5 => generated 1265 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:24.576314 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-e80a2dc7-a593-4ae1-aa1e-58821a80f560 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:24.577650 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-e80a2dc7-a593-4ae1-aa1e-58821a80f560 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 9107fc16-6a2c-48ad-8612-964c3ac05c01] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:24.589699 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e80a2dc7-a593-4ae1-aa1e-58821a80f560 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:24.595398 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e80a2dc7-a593-4ae1-aa1e-58821a80f560 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:24.596571 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e80a2dc7-a593-4ae1-aa1e-58821a80f560 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:24.597540 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e80a2dc7-a593-4ae1-aa1e-58821a80f560 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:24.600781 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e80a2dc7-a593-4ae1-aa1e-58821a80f560 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:24.602086 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e80a2dc7-a593-4ae1-aa1e-58821a80f560 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:24.718885 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-f6e2e7bb-862e-4042-919f-99a6433b0e70 req-57303f3b-9bd8-4514-944a-0ad793cff3f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16659e37-a119-4243-8211-1179306997a5", "tag": "315a8c1b-37a4-4871-af0b-4f209b89cc17"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:39:24.731541 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-f6e2e7bb-862e-4042-919f-99a6433b0e70 req-57303f3b-9bd8-4514-944a-0ad793cff3f6 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:24.732709 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-f6e2e7bb-862e-4042-919f-99a6433b0e70 req-57303f3b-9bd8-4514-944a-0ad793cff3f6 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:24.733444 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-f6e2e7bb-862e-4042-919f-99a6433b0e70 req-57303f3b-9bd8-4514-944a-0ad793cff3f6 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:24.761533 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-f6e2e7bb-862e-4042-919f-99a6433b0e70 req-57303f3b-9bd8-4514-944a-0ad793cff3f6 service nova] Creating event network-changed:315a8c1b-37a4-4871-af0b-4f209b89cc17 for instance 16659e37-a119-4243-8211-1179306997a5 on hv-cinder-85200 Aug 10 13:39:24.770176 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-f6e2e7bb-862e-4042-919f-99a6433b0e70 req-57303f3b-9bd8-4514-944a-0ad793cff3f6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058006 Aug 10 13:39:24.770913 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 93/208] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:39:24.818578 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-e80a2dc7-a593-4ae1-aa1e-58821a80f560 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:24.826210 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-e80a2dc7-a593-4ae1-aa1e-58821a80f560 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01" status: 200 len: 1520 microversion: 2.1 time: 0.255943 Aug 10 13:39:24.826788 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 116/209] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:24 2022] GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01 => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:25.303091 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-523e14c7-55bb-421c-bbb2-8a4724ad271d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:25.303757 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-523e14c7-55bb-421c-bbb2-8a4724ad271d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 16659e37-a119-4243-8211-1179306997a5] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:25.310190 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-523e14c7-55bb-421c-bbb2-8a4724ad271d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:25.310708 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-523e14c7-55bb-421c-bbb2-8a4724ad271d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:25.311194 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-523e14c7-55bb-421c-bbb2-8a4724ad271d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:25.311919 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-523e14c7-55bb-421c-bbb2-8a4724ad271d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:25.312380 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-523e14c7-55bb-421c-bbb2-8a4724ad271d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:25.312829 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-523e14c7-55bb-421c-bbb2-8a4724ad271d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:25.467154 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-523e14c7-55bb-421c-bbb2-8a4724ad271d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:25.474715 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-523e14c7-55bb-421c-bbb2-8a4724ad271d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5" status: 200 len: 1265 microversion: 2.1 time: 0.175999 Aug 10 13:39:25.475279 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 94/210] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:25 2022] GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:25.846885 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-101e5add-389d-4382-9c84-7026166f0ea1 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:25.848458 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-101e5add-389d-4382-9c84-7026166f0ea1 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 9107fc16-6a2c-48ad-8612-964c3ac05c01] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:25.857220 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-101e5add-389d-4382-9c84-7026166f0ea1 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:25.858069 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-101e5add-389d-4382-9c84-7026166f0ea1 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:25.858749 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-101e5add-389d-4382-9c84-7026166f0ea1 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:25.859577 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-101e5add-389d-4382-9c84-7026166f0ea1 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:25.860139 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-101e5add-389d-4382-9c84-7026166f0ea1 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:25.860632 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-101e5add-389d-4382-9c84-7026166f0ea1 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:26.059868 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-101e5add-389d-4382-9c84-7026166f0ea1 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:26.068072 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-101e5add-389d-4382-9c84-7026166f0ea1 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01" status: 200 len: 1520 microversion: 2.1 time: 0.224875 Aug 10 13:39:26.068698 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 117/211] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:25 2022] GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01 => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:26.494894 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-55911c5d-bafa-4d69-ab8e-4c57e9d31d73 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:26.495514 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-55911c5d-bafa-4d69-ab8e-4c57e9d31d73 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 16659e37-a119-4243-8211-1179306997a5] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:26.501602 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-55911c5d-bafa-4d69-ab8e-4c57e9d31d73 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:26.502085 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-55911c5d-bafa-4d69-ab8e-4c57e9d31d73 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:26.502520 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-55911c5d-bafa-4d69-ab8e-4c57e9d31d73 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:26.503205 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-55911c5d-bafa-4d69-ab8e-4c57e9d31d73 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:26.503654 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-55911c5d-bafa-4d69-ab8e-4c57e9d31d73 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:26.504075 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-55911c5d-bafa-4d69-ab8e-4c57e9d31d73 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:26.640186 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-55911c5d-bafa-4d69-ab8e-4c57e9d31d73 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:26.648403 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-55911c5d-bafa-4d69-ab8e-4c57e9d31d73 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5" status: 200 len: 1265 microversion: 2.1 time: 0.157218 Aug 10 13:39:26.651674 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 95/212] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:26 2022] GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:27.088796 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-93bd794e-b6d5-412c-8222-cd32c8136749 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:27.089435 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-93bd794e-b6d5-412c-8222-cd32c8136749 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 9107fc16-6a2c-48ad-8612-964c3ac05c01] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:27.106557 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-93bd794e-b6d5-412c-8222-cd32c8136749 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:27.106557 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-93bd794e-b6d5-412c-8222-cd32c8136749 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:27.106557 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-93bd794e-b6d5-412c-8222-cd32c8136749 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:27.106557 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-93bd794e-b6d5-412c-8222-cd32c8136749 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:27.106938 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-93bd794e-b6d5-412c-8222-cd32c8136749 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:27.106938 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-93bd794e-b6d5-412c-8222-cd32c8136749 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:27.236200 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-93bd794e-b6d5-412c-8222-cd32c8136749 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:27.244342 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-93bd794e-b6d5-412c-8222-cd32c8136749 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01" status: 200 len: 1520 microversion: 2.1 time: 0.159290 Aug 10 13:39:27.244918 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 118/213] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:27 2022] GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:27.674431 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-d21cc74b-9208-4b83-a875-ee8c0779c745 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:27.675058 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-d21cc74b-9208-4b83-a875-ee8c0779c745 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 16659e37-a119-4243-8211-1179306997a5] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:27.681607 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d21cc74b-9208-4b83-a875-ee8c0779c745 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:27.682162 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d21cc74b-9208-4b83-a875-ee8c0779c745 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:27.682668 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d21cc74b-9208-4b83-a875-ee8c0779c745 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:27.683361 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d21cc74b-9208-4b83-a875-ee8c0779c745 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:27.683825 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d21cc74b-9208-4b83-a875-ee8c0779c745 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:27.684248 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d21cc74b-9208-4b83-a875-ee8c0779c745 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:27.831402 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-d21cc74b-9208-4b83-a875-ee8c0779c745 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:27.835461 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:39:27.840882 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-d21cc74b-9208-4b83-a875-ee8c0779c745 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5" status: 200 len: 1265 microversion: 2.1 time: 0.170327 Aug 10 13:39:27.841521 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 96/214] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:27 2022] GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:28.265819 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-7149a4ed-15c9-4e26-a994-1f76c4d1860f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:28.266458 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-7149a4ed-15c9-4e26-a994-1f76c4d1860f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 9107fc16-6a2c-48ad-8612-964c3ac05c01] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:28.274179 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7149a4ed-15c9-4e26-a994-1f76c4d1860f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:28.275295 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7149a4ed-15c9-4e26-a994-1f76c4d1860f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:28.275970 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7149a4ed-15c9-4e26-a994-1f76c4d1860f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:28.277032 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7149a4ed-15c9-4e26-a994-1f76c4d1860f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:28.277549 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7149a4ed-15c9-4e26-a994-1f76c4d1860f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:28.278296 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7149a4ed-15c9-4e26-a994-1f76c4d1860f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:28.414613 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-7149a4ed-15c9-4e26-a994-1f76c4d1860f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:28.422112 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-7149a4ed-15c9-4e26-a994-1f76c4d1860f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01" status: 200 len: 1520 microversion: 2.1 time: 0.160130 Aug 10 13:39:28.422673 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 119/215] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:28 2022] GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:28.864495 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-4b140ca5-f5c3-4420-9c45-fba3236ab474 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:28.865254 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-4b140ca5-f5c3-4420-9c45-fba3236ab474 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 16659e37-a119-4243-8211-1179306997a5] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:28.873646 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4b140ca5-f5c3-4420-9c45-fba3236ab474 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:28.874370 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4b140ca5-f5c3-4420-9c45-fba3236ab474 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:28.874808 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4b140ca5-f5c3-4420-9c45-fba3236ab474 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:28.875516 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4b140ca5-f5c3-4420-9c45-fba3236ab474 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:28.875972 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4b140ca5-f5c3-4420-9c45-fba3236ab474 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:28.876401 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4b140ca5-f5c3-4420-9c45-fba3236ab474 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:29.009620 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-4b140ca5-f5c3-4420-9c45-fba3236ab474 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:29.017566 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-4b140ca5-f5c3-4420-9c45-fba3236ab474 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5" status: 200 len: 1265 microversion: 2.1 time: 0.160426 Aug 10 13:39:29.018070 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 97/216] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:28 2022] GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:29.443854 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-1294fcaf-9962-4a66-80d1-538f37cebab5 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:29.444585 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-1294fcaf-9962-4a66-80d1-538f37cebab5 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 9107fc16-6a2c-48ad-8612-964c3ac05c01] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:29.450811 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1294fcaf-9962-4a66-80d1-538f37cebab5 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:29.451285 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1294fcaf-9962-4a66-80d1-538f37cebab5 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:29.451708 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1294fcaf-9962-4a66-80d1-538f37cebab5 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:29.452391 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1294fcaf-9962-4a66-80d1-538f37cebab5 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:29.452831 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1294fcaf-9962-4a66-80d1-538f37cebab5 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:29.453321 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1294fcaf-9962-4a66-80d1-538f37cebab5 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:29.539148 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell0:SELECT=2 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:39:29.586914 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-1294fcaf-9962-4a66-80d1-538f37cebab5 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:29.594469 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-1294fcaf-9962-4a66-80d1-538f37cebab5 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01" status: 200 len: 1520 microversion: 2.1 time: 0.155345 Aug 10 13:39:29.595033 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 120/217] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:29 2022] GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:30.038958 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-31bffac8-b6ec-45c5-a200-ddb46a437629 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:30.039589 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-31bffac8-b6ec-45c5-a200-ddb46a437629 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 16659e37-a119-4243-8211-1179306997a5] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:30.041472 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell0:SELECT=2 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:39:30.042230 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell0:SELECT=6 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:39:30.048451 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-31bffac8-b6ec-45c5-a200-ddb46a437629 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:30.048929 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-31bffac8-b6ec-45c5-a200-ddb46a437629 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:30.049379 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-31bffac8-b6ec-45c5-a200-ddb46a437629 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:30.050060 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-31bffac8-b6ec-45c5-a200-ddb46a437629 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:30.050511 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-31bffac8-b6ec-45c5-a200-ddb46a437629 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:30.050927 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-31bffac8-b6ec-45c5-a200-ddb46a437629 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:30.186336 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-31bffac8-b6ec-45c5-a200-ddb46a437629 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:30.194297 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-31bffac8-b6ec-45c5-a200-ddb46a437629 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5" status: 200 len: 1265 microversion: 2.1 time: 0.159782 Aug 10 13:39:30.194863 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 98/218] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:30 2022] GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:39:30.619734 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-605583b1-2846-4ad8-bea1-f4dcbbfffe7f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:30.620368 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-605583b1-2846-4ad8-bea1-f4dcbbfffe7f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 9107fc16-6a2c-48ad-8612-964c3ac05c01] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:30.642580 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-605583b1-2846-4ad8-bea1-f4dcbbfffe7f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:30.643076 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-605583b1-2846-4ad8-bea1-f4dcbbfffe7f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:30.643507 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-605583b1-2846-4ad8-bea1-f4dcbbfffe7f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:30.648137 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-605583b1-2846-4ad8-bea1-f4dcbbfffe7f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:30.648476 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-605583b1-2846-4ad8-bea1-f4dcbbfffe7f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:30.648895 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-605583b1-2846-4ad8-bea1-f4dcbbfffe7f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:30.817352 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-605583b1-2846-4ad8-bea1-f4dcbbfffe7f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:30.829467 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-605583b1-2846-4ad8-bea1-f4dcbbfffe7f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01" status: 200 len: 1520 microversion: 2.1 time: 0.217127 Aug 10 13:39:30.830213 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 121/219] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:30 2022] GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01 => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:39:31.214775 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-6f2ec3e2-f7f8-4eef-8cc9-bcc238aa8ed7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:31.215407 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-6f2ec3e2-f7f8-4eef-8cc9-bcc238aa8ed7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 16659e37-a119-4243-8211-1179306997a5] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:31.221361 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6f2ec3e2-f7f8-4eef-8cc9-bcc238aa8ed7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:31.221842 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6f2ec3e2-f7f8-4eef-8cc9-bcc238aa8ed7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:31.222274 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6f2ec3e2-f7f8-4eef-8cc9-bcc238aa8ed7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:31.222966 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6f2ec3e2-f7f8-4eef-8cc9-bcc238aa8ed7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:31.224183 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6f2ec3e2-f7f8-4eef-8cc9-bcc238aa8ed7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:31.224611 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6f2ec3e2-f7f8-4eef-8cc9-bcc238aa8ed7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:31.379577 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-6f2ec3e2-f7f8-4eef-8cc9-bcc238aa8ed7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:31.388068 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-6f2ec3e2-f7f8-4eef-8cc9-bcc238aa8ed7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5" status: 200 len: 1265 microversion: 2.1 time: 0.176921 Aug 10 13:39:31.388660 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 99/220] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:31 2022] GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:31.853197 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-3a7e4818-4fae-4b41-98c1-1bc640e55b62 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:31.854048 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-3a7e4818-4fae-4b41-98c1-1bc640e55b62 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 9107fc16-6a2c-48ad-8612-964c3ac05c01] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:31.860744 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3a7e4818-4fae-4b41-98c1-1bc640e55b62 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:31.861821 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3a7e4818-4fae-4b41-98c1-1bc640e55b62 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:31.863037 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3a7e4818-4fae-4b41-98c1-1bc640e55b62 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:31.863982 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3a7e4818-4fae-4b41-98c1-1bc640e55b62 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:31.865388 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3a7e4818-4fae-4b41-98c1-1bc640e55b62 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:31.866224 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3a7e4818-4fae-4b41-98c1-1bc640e55b62 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:32.013272 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-3a7e4818-4fae-4b41-98c1-1bc640e55b62 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:32.021666 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-3a7e4818-4fae-4b41-98c1-1bc640e55b62 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01" status: 200 len: 1520 microversion: 2.1 time: 0.173133 Aug 10 13:39:32.022241 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 122/221] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:31 2022] GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:32.408884 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-63d3afdf-521b-4c9b-b9cf-b79d82f099d2 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:32.409549 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-63d3afdf-521b-4c9b-b9cf-b79d82f099d2 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 16659e37-a119-4243-8211-1179306997a5] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:32.418418 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-63d3afdf-521b-4c9b-b9cf-b79d82f099d2 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:32.418912 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-63d3afdf-521b-4c9b-b9cf-b79d82f099d2 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:32.419476 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-63d3afdf-521b-4c9b-b9cf-b79d82f099d2 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:32.420264 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-63d3afdf-521b-4c9b-b9cf-b79d82f099d2 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:32.420713 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-63d3afdf-521b-4c9b-b9cf-b79d82f099d2 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:32.421148 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-63d3afdf-521b-4c9b-b9cf-b79d82f099d2 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:32.557167 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-63d3afdf-521b-4c9b-b9cf-b79d82f099d2 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:32.564522 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-63d3afdf-521b-4c9b-b9cf-b79d82f099d2 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5" status: 200 len: 1265 microversion: 2.1 time: 0.159413 Aug 10 13:39:32.565157 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 100/222] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:32 2022] GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:33.043550 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-f2a604ac-ad33-4c8f-9200-9cb32151b9f0 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:33.044266 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-f2a604ac-ad33-4c8f-9200-9cb32151b9f0 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 9107fc16-6a2c-48ad-8612-964c3ac05c01] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:33.050612 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f2a604ac-ad33-4c8f-9200-9cb32151b9f0 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:33.051196 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f2a604ac-ad33-4c8f-9200-9cb32151b9f0 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:33.051779 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f2a604ac-ad33-4c8f-9200-9cb32151b9f0 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:33.053359 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f2a604ac-ad33-4c8f-9200-9cb32151b9f0 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:33.053932 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f2a604ac-ad33-4c8f-9200-9cb32151b9f0 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:33.054425 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f2a604ac-ad33-4c8f-9200-9cb32151b9f0 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:33.212107 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-f2a604ac-ad33-4c8f-9200-9cb32151b9f0 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:33.221311 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-f2a604ac-ad33-4c8f-9200-9cb32151b9f0 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01" status: 200 len: 1520 microversion: 2.1 time: 0.181447 Aug 10 13:39:33.221883 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 123/223] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:33 2022] GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:39:33.585969 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-4a1ccafa-41e0-46b1-81ad-4a0ead618a60 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:33.586774 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-4a1ccafa-41e0-46b1-81ad-4a0ead618a60 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 16659e37-a119-4243-8211-1179306997a5] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:33.594375 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4a1ccafa-41e0-46b1-81ad-4a0ead618a60 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:33.595121 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4a1ccafa-41e0-46b1-81ad-4a0ead618a60 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:33.595749 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4a1ccafa-41e0-46b1-81ad-4a0ead618a60 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:33.596621 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4a1ccafa-41e0-46b1-81ad-4a0ead618a60 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:33.597448 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4a1ccafa-41e0-46b1-81ad-4a0ead618a60 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:33.597984 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4a1ccafa-41e0-46b1-81ad-4a0ead618a60 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:33.790801 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-4a1ccafa-41e0-46b1-81ad-4a0ead618a60 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:33.799549 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-4a1ccafa-41e0-46b1-81ad-4a0ead618a60 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5" status: 200 len: 1265 microversion: 2.1 time: 0.217872 Aug 10 13:39:33.800225 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 101/224] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:33 2022] GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5 => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:34.242001 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-8c62c80a-5596-4f2e-8732-f590a038198f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:34.242615 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-8c62c80a-5596-4f2e-8732-f590a038198f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 9107fc16-6a2c-48ad-8612-964c3ac05c01] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:34.248857 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8c62c80a-5596-4f2e-8732-f590a038198f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:34.249393 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8c62c80a-5596-4f2e-8732-f590a038198f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:34.249825 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8c62c80a-5596-4f2e-8732-f590a038198f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:34.250693 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8c62c80a-5596-4f2e-8732-f590a038198f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:34.251307 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8c62c80a-5596-4f2e-8732-f590a038198f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:34.251733 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8c62c80a-5596-4f2e-8732-f590a038198f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:34.404521 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-8c62c80a-5596-4f2e-8732-f590a038198f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:34.412249 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-8c62c80a-5596-4f2e-8732-f590a038198f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01" status: 200 len: 1520 microversion: 2.1 time: 0.174899 Aug 10 13:39:34.412957 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 124/225] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:34 2022] GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:34.824118 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-df1af39d-1c80-4daf-a98f-71cd0cfe5760 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:34.825246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-df1af39d-1c80-4daf-a98f-71cd0cfe5760 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 16659e37-a119-4243-8211-1179306997a5] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:34.835051 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-df1af39d-1c80-4daf-a98f-71cd0cfe5760 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:34.835709 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-df1af39d-1c80-4daf-a98f-71cd0cfe5760 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:34.836870 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-df1af39d-1c80-4daf-a98f-71cd0cfe5760 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:34.837629 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-df1af39d-1c80-4daf-a98f-71cd0cfe5760 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:34.838208 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-df1af39d-1c80-4daf-a98f-71cd0cfe5760 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:34.838641 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-df1af39d-1c80-4daf-a98f-71cd0cfe5760 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:34.995789 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-df1af39d-1c80-4daf-a98f-71cd0cfe5760 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:35.004125 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-df1af39d-1c80-4daf-a98f-71cd0cfe5760 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5" status: 200 len: 1265 microversion: 2.1 time: 0.184003 Aug 10 13:39:35.004688 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 102/226] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:34 2022] GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:35.435808 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-feebbe48-9655-455d-856d-fd84914c15df tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:35.436421 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-feebbe48-9655-455d-856d-fd84914c15df tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 9107fc16-6a2c-48ad-8612-964c3ac05c01] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:35.444404 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-feebbe48-9655-455d-856d-fd84914c15df tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:35.444884 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-feebbe48-9655-455d-856d-fd84914c15df tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:35.445339 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-feebbe48-9655-455d-856d-fd84914c15df tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:35.446273 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-feebbe48-9655-455d-856d-fd84914c15df tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:35.446725 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-feebbe48-9655-455d-856d-fd84914c15df tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:35.447140 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-feebbe48-9655-455d-856d-fd84914c15df tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:35.577578 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-feebbe48-9655-455d-856d-fd84914c15df tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:35.586241 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-feebbe48-9655-455d-856d-fd84914c15df tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01" status: 200 len: 1520 microversion: 2.1 time: 0.156571 Aug 10 13:39:35.589265 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 125/227] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:35 2022] GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:35.589586 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-87e6dcc8-9dea-4d53-a3f2-b58599c489c8 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:35.589784 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-87e6dcc8-9dea-4d53-a3f2-b58599c489c8 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 41baab24-f648-4e7d-83bb-4357214ea438] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:35.596004 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-87e6dcc8-9dea-4d53-a3f2-b58599c489c8 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:35.596491 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-87e6dcc8-9dea-4d53-a3f2-b58599c489c8 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:35.596928 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-87e6dcc8-9dea-4d53-a3f2-b58599c489c8 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:35.597647 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-87e6dcc8-9dea-4d53-a3f2-b58599c489c8 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:35.598101 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-87e6dcc8-9dea-4d53-a3f2-b58599c489c8 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:35.598555 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-87e6dcc8-9dea-4d53-a3f2-b58599c489c8 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:35.621514 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-87e6dcc8-9dea-4d53-a3f2-b58599c489c8 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438/ips" status: 200 len: 151 microversion: 2.1 time: 0.036141 Aug 10 13:39:35.622268 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 103/228] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Aug 10 13:39:35 2022] GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:39:36.024483 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-30e6ca66-055d-4318-b9b8-c8c801c062cc tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:36.025081 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-30e6ca66-055d-4318-b9b8-c8c801c062cc tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 16659e37-a119-4243-8211-1179306997a5] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:36.031171 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-30e6ca66-055d-4318-b9b8-c8c801c062cc tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:36.031655 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-30e6ca66-055d-4318-b9b8-c8c801c062cc tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:36.032087 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-30e6ca66-055d-4318-b9b8-c8c801c062cc tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:36.032774 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-30e6ca66-055d-4318-b9b8-c8c801c062cc tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:36.033222 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-30e6ca66-055d-4318-b9b8-c8c801c062cc tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:36.033676 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-30e6ca66-055d-4318-b9b8-c8c801c062cc tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:36.182235 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-30e6ca66-055d-4318-b9b8-c8c801c062cc tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:36.190777 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-30e6ca66-055d-4318-b9b8-c8c801c062cc tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5" status: 200 len: 1265 microversion: 2.1 time: 0.170687 Aug 10 13:39:36.191552 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 126/229] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:36 2022] GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:36.304172 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-8a1d6715-2f08-4328-a5fb-5b472933baf6 req-a7968162-486c-4f4c-b374-0c21180c78d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16659e37-a119-4243-8211-1179306997a5", "name": "network-vif-plugged", "status": "completed", "tag": "315a8c1b-37a4-4871-af0b-4f209b89cc17"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:39:36.309777 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:39:36.318412 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-8a1d6715-2f08-4328-a5fb-5b472933baf6 req-a7968162-486c-4f4c-b374-0c21180c78d8 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:36.318834 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-8a1d6715-2f08-4328-a5fb-5b472933baf6 req-a7968162-486c-4f4c-b374-0c21180c78d8 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:36.319262 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-8a1d6715-2f08-4328-a5fb-5b472933baf6 req-a7968162-486c-4f4c-b374-0c21180c78d8 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:36.331032 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-8a1d6715-2f08-4328-a5fb-5b472933baf6 req-a7968162-486c-4f4c-b374-0c21180c78d8 service nova] Creating event network-vif-plugged:315a8c1b-37a4-4871-af0b-4f209b89cc17 for instance 16659e37-a119-4243-8211-1179306997a5 on hv-cinder-85200 Aug 10 13:39:36.338513 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-8a1d6715-2f08-4328-a5fb-5b472933baf6 req-a7968162-486c-4f4c-b374-0c21180c78d8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037929 Aug 10 13:39:36.339218 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 104/230] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:39:36.607126 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-10811d16-6c8c-4824-b10d-63178eec2358 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:36.607737 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-10811d16-6c8c-4824-b10d-63178eec2358 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 9107fc16-6a2c-48ad-8612-964c3ac05c01] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:36.614454 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-10811d16-6c8c-4824-b10d-63178eec2358 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:36.614940 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-10811d16-6c8c-4824-b10d-63178eec2358 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:36.615367 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-10811d16-6c8c-4824-b10d-63178eec2358 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:36.616051 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-10811d16-6c8c-4824-b10d-63178eec2358 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:36.616495 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-10811d16-6c8c-4824-b10d-63178eec2358 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:36.616911 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-10811d16-6c8c-4824-b10d-63178eec2358 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:36.746984 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-10811d16-6c8c-4824-b10d-63178eec2358 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:36.754309 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-10811d16-6c8c-4824-b10d-63178eec2358 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01" status: 200 len: 1520 microversion: 2.1 time: 0.151116 Aug 10 13:39:36.754871 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 127/231] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:36 2022] GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:37.018919 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-855d57e8-9852-4481-b94c-78fde9ec745b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df1b6cd6-7430-4566-87b8-0476af2cea6a"}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:39:37.021931 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-855d57e8-9852-4481-b94c-78fde9ec745b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 41baab24-f648-4e7d-83bb-4357214ea438] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:37.027928 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-855d57e8-9852-4481-b94c-78fde9ec745b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:37.028405 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-855d57e8-9852-4481-b94c-78fde9ec745b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:37.028832 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-855d57e8-9852-4481-b94c-78fde9ec745b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:37.029538 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-855d57e8-9852-4481-b94c-78fde9ec745b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:37.029988 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-855d57e8-9852-4481-b94c-78fde9ec745b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:37.030403 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-855d57e8-9852-4481-b94c-78fde9ec745b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:37.212310 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-a4ad070a-e41f-4d0b-ad76-373228e69f24 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:37.212854 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-a4ad070a-e41f-4d0b-ad76-373228e69f24 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 16659e37-a119-4243-8211-1179306997a5] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:37.219636 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a4ad070a-e41f-4d0b-ad76-373228e69f24 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:37.220119 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a4ad070a-e41f-4d0b-ad76-373228e69f24 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:37.220539 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a4ad070a-e41f-4d0b-ad76-373228e69f24 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:37.221275 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a4ad070a-e41f-4d0b-ad76-373228e69f24 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:37.221721 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a4ad070a-e41f-4d0b-ad76-373228e69f24 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:37.222140 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a4ad070a-e41f-4d0b-ad76-373228e69f24 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:37.368929 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-a4ad070a-e41f-4d0b-ad76-373228e69f24 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:37.371184 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell1:SELECT=100 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:39:37.378376 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-a4ad070a-e41f-4d0b-ad76-373228e69f24 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5" status: 200 len: 1265 microversion: 2.1 time: 0.170030 Aug 10 13:39:37.379046 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 128/232] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:37 2022] GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:39:37.696624 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-855d57e8-9852-4481-b94c-78fde9ec745b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "POST /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.681626 Aug 10 13:39:37.697612 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 105/233] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 10 13:39:37 2022] POST /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438/os-volume_attachments => generated 194 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:39:37.774846 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-b88b6057-6218-4778-8544-02b4a6a1f823 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:37.775457 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-b88b6057-6218-4778-8544-02b4a6a1f823 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 9107fc16-6a2c-48ad-8612-964c3ac05c01] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:37.782267 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b88b6057-6218-4778-8544-02b4a6a1f823 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:37.782759 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b88b6057-6218-4778-8544-02b4a6a1f823 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:37.783186 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b88b6057-6218-4778-8544-02b4a6a1f823 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:37.783887 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b88b6057-6218-4778-8544-02b4a6a1f823 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:37.784329 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b88b6057-6218-4778-8544-02b4a6a1f823 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:37.790066 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b88b6057-6218-4778-8544-02b4a6a1f823 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:37.947288 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-b88b6057-6218-4778-8544-02b4a6a1f823 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:37.954791 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-b88b6057-6218-4778-8544-02b4a6a1f823 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01" status: 200 len: 1520 microversion: 2.1 time: 0.184235 Aug 10 13:39:37.955613 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 129/234] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:37 2022] GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:38.400058 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-3b2dcbc3-3f21-4a7f-9af4-d94120a8f27c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:38.400773 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-3b2dcbc3-3f21-4a7f-9af4-d94120a8f27c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 16659e37-a119-4243-8211-1179306997a5] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:38.407124 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3b2dcbc3-3f21-4a7f-9af4-d94120a8f27c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:38.407604 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3b2dcbc3-3f21-4a7f-9af4-d94120a8f27c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:38.408033 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3b2dcbc3-3f21-4a7f-9af4-d94120a8f27c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:38.408727 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3b2dcbc3-3f21-4a7f-9af4-d94120a8f27c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:38.409165 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3b2dcbc3-3f21-4a7f-9af4-d94120a8f27c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:38.409612 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3b2dcbc3-3f21-4a7f-9af4-d94120a8f27c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:38.559467 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-3b2dcbc3-3f21-4a7f-9af4-d94120a8f27c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:38.569094 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-3b2dcbc3-3f21-4a7f-9af4-d94120a8f27c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5" status: 200 len: 1265 microversion: 2.1 time: 0.173795 Aug 10 13:39:38.570113 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 106/235] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:38 2022] GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:38.975595 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-a9b88a28-6f84-4dcb-9e6d-71568e604904 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:38.976313 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-a9b88a28-6f84-4dcb-9e6d-71568e604904 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 9107fc16-6a2c-48ad-8612-964c3ac05c01] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:38.982756 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a9b88a28-6f84-4dcb-9e6d-71568e604904 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:38.983312 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a9b88a28-6f84-4dcb-9e6d-71568e604904 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:38.983814 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a9b88a28-6f84-4dcb-9e6d-71568e604904 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:38.984577 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a9b88a28-6f84-4dcb-9e6d-71568e604904 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:38.985117 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a9b88a28-6f84-4dcb-9e6d-71568e604904 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:38.985629 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a9b88a28-6f84-4dcb-9e6d-71568e604904 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:39.134427 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-a9b88a28-6f84-4dcb-9e6d-71568e604904 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:39.143847 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-a9b88a28-6f84-4dcb-9e6d-71568e604904 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01" status: 200 len: 1520 microversion: 2.1 time: 0.172035 Aug 10 13:39:39.144561 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 130/236] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:38 2022] GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:39.574108 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-5296a9ea-c9b7-4cd4-8885-83ca90b9bbb2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:39.574617 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-5296a9ea-c9b7-4cd4-8885-83ca90b9bbb2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:39.580905 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5296a9ea-c9b7-4cd4-8885-83ca90b9bbb2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:39.581431 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5296a9ea-c9b7-4cd4-8885-83ca90b9bbb2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:39.581866 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5296a9ea-c9b7-4cd4-8885-83ca90b9bbb2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:39.582554 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5296a9ea-c9b7-4cd4-8885-83ca90b9bbb2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:39.583523 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5296a9ea-c9b7-4cd4-8885-83ca90b9bbb2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:39.583954 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5296a9ea-c9b7-4cd4-8885-83ca90b9bbb2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:39.590811 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-37c767d7-be21-412f-b20e-e3ad85ea7de5 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:39.591587 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-37c767d7-be21-412f-b20e-e3ad85ea7de5 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 16659e37-a119-4243-8211-1179306997a5] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:39.597833 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-37c767d7-be21-412f-b20e-e3ad85ea7de5 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:39.598430 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-37c767d7-be21-412f-b20e-e3ad85ea7de5 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:39.599970 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-37c767d7-be21-412f-b20e-e3ad85ea7de5 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:39.600525 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-37c767d7-be21-412f-b20e-e3ad85ea7de5 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:39.601094 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-37c767d7-be21-412f-b20e-e3ad85ea7de5 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:39.601658 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-37c767d7-be21-412f-b20e-e3ad85ea7de5 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:39.608288 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-5296a9ea-c9b7-4cd4-8885-83ca90b9bbb2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb/ips" status: 200 len: 152 microversion: 2.20 time: 0.038090 Aug 10 13:39:39.609067 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 107/237] 10.222.0.52 () {60 vars in 1289 bytes} [Wed Aug 10 13:39:39 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 13:39:39.761554 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-37c767d7-be21-412f-b20e-e3ad85ea7de5 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:39.773088 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-37c767d7-be21-412f-b20e-e3ad85ea7de5 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5" status: 200 len: 1452 microversion: 2.1 time: 0.186629 Aug 10 13:39:39.773779 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 131/238] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:39 2022] GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5 => generated 1452 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:39:39.795464 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-68506a0a-3383-4af9-84fb-2838ad23bd70 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:39.796066 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-68506a0a-3383-4af9-84fb-2838ad23bd70 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 16659e37-a119-4243-8211-1179306997a5] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:39.803306 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-68506a0a-3383-4af9-84fb-2838ad23bd70 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:39.803775 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-68506a0a-3383-4af9-84fb-2838ad23bd70 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:39.804378 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-68506a0a-3383-4af9-84fb-2838ad23bd70 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:39.805215 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-68506a0a-3383-4af9-84fb-2838ad23bd70 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:39.805866 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-68506a0a-3383-4af9-84fb-2838ad23bd70 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:39.806278 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-68506a0a-3383-4af9-84fb-2838ad23bd70 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:39.971955 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-68506a0a-3383-4af9-84fb-2838ad23bd70 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:39.980103 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-68506a0a-3383-4af9-84fb-2838ad23bd70 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5" status: 200 len: 1452 microversion: 2.1 time: 0.188565 Aug 10 13:39:39.982108 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 108/239] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:39 2022] GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5 => generated 1452 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:40.165171 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-44ac500b-a314-4dd3-986b-2f04e782311c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:40.167253 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-44ac500b-a314-4dd3-986b-2f04e782311c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 9107fc16-6a2c-48ad-8612-964c3ac05c01] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:40.180129 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-44ac500b-a314-4dd3-986b-2f04e782311c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:40.181352 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-44ac500b-a314-4dd3-986b-2f04e782311c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:40.182194 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-44ac500b-a314-4dd3-986b-2f04e782311c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:40.183147 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-44ac500b-a314-4dd3-986b-2f04e782311c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:40.183781 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-44ac500b-a314-4dd3-986b-2f04e782311c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:40.184383 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-44ac500b-a314-4dd3-986b-2f04e782311c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:40.340908 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-44ac500b-a314-4dd3-986b-2f04e782311c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:40.350339 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-44ac500b-a314-4dd3-986b-2f04e782311c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01" status: 200 len: 1520 microversion: 2.1 time: 0.189189 Aug 10 13:39:40.350964 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 132/240] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:40 2022] GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01 => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:41.372689 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-4f783c45-a6fb-4f82-a64d-1671b085f5ba tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:41.373624 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-4f783c45-a6fb-4f82-a64d-1671b085f5ba tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 9107fc16-6a2c-48ad-8612-964c3ac05c01] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:41.380706 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4f783c45-a6fb-4f82-a64d-1671b085f5ba tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:41.381377 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4f783c45-a6fb-4f82-a64d-1671b085f5ba tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:41.381905 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4f783c45-a6fb-4f82-a64d-1671b085f5ba tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:41.382690 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4f783c45-a6fb-4f82-a64d-1671b085f5ba tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:41.383311 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4f783c45-a6fb-4f82-a64d-1671b085f5ba tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:41.383973 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4f783c45-a6fb-4f82-a64d-1671b085f5ba tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:41.701672 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-4f783c45-a6fb-4f82-a64d-1671b085f5ba tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:41.711214 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-4f783c45-a6fb-4f82-a64d-1671b085f5ba tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01" status: 200 len: 1520 microversion: 2.1 time: 0.342852 Aug 10 13:39:41.712198 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 109/241] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:41 2022] GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01 => generated 1520 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:42.343354 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-b0d06386-5085-47fb-8e1c-8cf522b53dda tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:39:42.343888 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-b0d06386-5085-47fb-8e1c-8cf522b53dda tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:42.346270 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_api:SELECT=52 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:39:42.353995 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b0d06386-5085-47fb-8e1c-8cf522b53dda tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:42.355211 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b0d06386-5085-47fb-8e1c-8cf522b53dda tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:42.355970 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b0d06386-5085-47fb-8e1c-8cf522b53dda tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:42.357520 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b0d06386-5085-47fb-8e1c-8cf522b53dda tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:42.357983 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b0d06386-5085-47fb-8e1c-8cf522b53dda tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:42.358727 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b0d06386-5085-47fb-8e1c-8cf522b53dda tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:42.387822 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.objects.instance [None req-b0d06386-5085-47fb-8e1c-8cf522b53dda tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lazy-loading 'flavor' on Instance uuid cdba9a34-3f3e-4314-a377-e6dc259c27cb {{(pid=129522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:39:42.593537 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-b995686f-f70e-4a94-a023-24bba5acbfda req-881d0ca6-da00-454e-b37a-4c9d148a0545 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16659e37-a119-4243-8211-1179306997a5", "tag": "315a8c1b-37a4-4871-af0b-4f209b89cc17"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:39:42.610786 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-b995686f-f70e-4a94-a023-24bba5acbfda req-881d0ca6-da00-454e-b37a-4c9d148a0545 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:42.612235 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-b995686f-f70e-4a94-a023-24bba5acbfda req-881d0ca6-da00-454e-b37a-4c9d148a0545 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:42.613216 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-b995686f-f70e-4a94-a023-24bba5acbfda req-881d0ca6-da00-454e-b37a-4c9d148a0545 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:42.627965 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-b995686f-f70e-4a94-a023-24bba5acbfda req-881d0ca6-da00-454e-b37a-4c9d148a0545 service nova] Creating event network-changed:315a8c1b-37a4-4871-af0b-4f209b89cc17 for instance 16659e37-a119-4243-8211-1179306997a5 on hv-cinder-85200 Aug 10 13:39:42.636108 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-b995686f-f70e-4a94-a023-24bba5acbfda req-881d0ca6-da00-454e-b37a-4c9d148a0545 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047793 Aug 10 13:39:42.637690 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 110/242] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:39:42.732688 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-4387f04b-1e1d-4287-8f5f-fe4cbf051e9f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:42.733413 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-4387f04b-1e1d-4287-8f5f-fe4cbf051e9f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 9107fc16-6a2c-48ad-8612-964c3ac05c01] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:42.745910 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4387f04b-1e1d-4287-8f5f-fe4cbf051e9f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:42.746560 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4387f04b-1e1d-4287-8f5f-fe4cbf051e9f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:42.747216 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4387f04b-1e1d-4287-8f5f-fe4cbf051e9f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:42.748395 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4387f04b-1e1d-4287-8f5f-fe4cbf051e9f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:42.749043 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4387f04b-1e1d-4287-8f5f-fe4cbf051e9f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:42.749689 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4387f04b-1e1d-4287-8f5f-fe4cbf051e9f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:42.855229 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-b0d06386-5085-47fb-8e1c-8cf522b53dda tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "POST /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb/action" status: 202 len: 0 microversion: 2.20 time: 0.513293 Aug 10 13:39:42.861661 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 133/243] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Aug 10 13:39:42 2022] POST /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb/action => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:39:42.878591 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-e1062992-da57-4ba9-bf8e-3425affe83ba tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:42.881104 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-e1062992-da57-4ba9-bf8e-3425affe83ba tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:42.899088 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e1062992-da57-4ba9-bf8e-3425affe83ba tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:42.899597 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e1062992-da57-4ba9-bf8e-3425affe83ba tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:42.902831 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e1062992-da57-4ba9-bf8e-3425affe83ba tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:42.903564 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e1062992-da57-4ba9-bf8e-3425affe83ba tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:42.904028 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e1062992-da57-4ba9-bf8e-3425affe83ba tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:42.904455 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e1062992-da57-4ba9-bf8e-3425affe83ba tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:43.053107 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-4387f04b-1e1d-4287-8f5f-fe4cbf051e9f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:43.061711 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-4387f04b-1e1d-4287-8f5f-fe4cbf051e9f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01" status: 200 len: 1500 microversion: 2.1 time: 0.333393 Aug 10 13:39:43.063261 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 111/244] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:42 2022] GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01 => generated 1500 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:39:43.085259 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-943100fc-08d4-4d71-91f5-0ae67c078cec tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "955c3a34-2a6f-4275-ab1a-4bae788a3fad"}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:39:43.087943 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-943100fc-08d4-4d71-91f5-0ae67c078cec tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 9107fc16-6a2c-48ad-8612-964c3ac05c01] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:43.120831 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-943100fc-08d4-4d71-91f5-0ae67c078cec tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:43.121385 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-943100fc-08d4-4d71-91f5-0ae67c078cec tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:43.121820 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-943100fc-08d4-4d71-91f5-0ae67c078cec tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:43.122520 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-943100fc-08d4-4d71-91f5-0ae67c078cec tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:43.122971 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-943100fc-08d4-4d71-91f5-0ae67c078cec tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:43.123389 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-943100fc-08d4-4d71-91f5-0ae67c078cec tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:43.136227 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-e1062992-da57-4ba9-bf8e-3425affe83ba tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:43.145793 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-e1062992-da57-4ba9-bf8e-3425affe83ba tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:43.148588 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-e1062992-da57-4ba9-bf8e-3425affe83ba tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:43.150313 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-e1062992-da57-4ba9-bf8e-3425affe83ba tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1725 microversion: 2.20 time: 0.285243 Aug 10 13:39:43.151353 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 134/245] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:39:42 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1725 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:39:43.193284 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.wsgi [None req-943100fc-08d4-4d71-91f5-0ae67c078cec tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] HTTP exception thrown: Cannot 'attach_volume' instance 9107fc16-6a2c-48ad-8612-964c3ac05c01 while it is in vm_state rescued Aug 10 13:39:43.197918 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-943100fc-08d4-4d71-91f5-0ae67c078cec tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Request method failure captured: Aug 10 13:39:43.197918 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: request: POST /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01/os-volume_attachments HTTP/1.1 Aug 10 13:39:43.197918 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept: application/json Aug 10 13:39:43.197918 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept-Encoding: identity Aug 10 13:39:43.197918 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Connection: close Aug 10 13:39:43.197918 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Length: 74 Aug 10 13:39:43.197918 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Type: application/json Aug 10 13:39:43.197918 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Host: 10.222.0.52 Aug 10 13:39:43.197918 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Openstack-System-Scope: None Aug 10 13:39:43.197918 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: User-Agent: python-urllib3/1.26.11 Aug 10 13:39:43.197918 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Auth-Token: gAAAAABi87SyiKkY4w5thpU-lMeFOv-pupV3M4p5O_G9Bq0nw7Mt72anXX_8NpPA6bSBk3F77efaTtx9_wfsx9tfpnDHinM6_nwESAvKYqiVuXh6I6GeGsfaWe_Ya10ueo8dBFFLc_3EiOnm1SU3tp8oyoyNzcvZhdKgk0BRE0yUrE4ibPeYstg Aug 10 13:39:43.197918 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Id: None Aug 10 13:39:43.197918 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Name: None Aug 10 13:39:43.197918 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Identity-Status: Confirmed Aug 10 13:39:43.197918 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Is-Admin-Project: True Aug 10 13:39:43.197918 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Id: default Aug 10 13:39:43.197918 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Name: Default Aug 10 13:39:43.197918 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Id: d8eda7c7d6a348e08e81a6b2496b09e5 Aug 10 13:39:43.197918 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2121919159 Aug 10 13:39:43.197918 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Role: member,reader Aug 10 13:39:43.197918 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Roles: member,reader Aug 10 13:39:43.199527 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d8eda7c7d6a348e08e81a6b2496b09e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d8eda7c7d6a348e08e81a6b2496b09e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d8eda7c7d6a348e08e81a6b2496b09e5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d8eda7c7d6a348e08e81a6b2496b09e5"}]}] Aug 10 13:39:43.199527 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2121919159 Aug 10 13:39:43.199527 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Id: d8eda7c7d6a348e08e81a6b2496b09e5 Aug 10 13:39:43.199527 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2121919159 Aug 10 13:39:43.199527 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User: tempest-ServerRescueNegativeTestJSON-2121919159-project Aug 10 13:39:43.199527 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Id: default Aug 10 13:39:43.199527 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Name: Default Aug 10 13:39:43.199527 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Id: 5573338f0bd64c729c7d89345069ca6f Aug 10 13:39:43.199527 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2121919159-project Aug 10 13:39:43.199527 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Aug 10 13:39:43.199527 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: {"volumeAttachment": {"volumeId": "955c3a34-2a6f-4275-ab1a-4bae788a3fad"}} Aug 10 13:39:43.199527 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: method: > Aug 10 13:39:43.200316 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: exception: Cannot 'attach_volume' instance 9107fc16-6a2c-48ad-8612-964c3ac05c01 while it is in vm_state rescued Aug 10 13:39:43.200316 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: action_args: {'server_id': '9107fc16-6a2c-48ad-8612-964c3ac05c01', 'body': {'volumeAttachment': {'volumeId': '955c3a34-2a6f-4275-ab1a-4bae788a3fad'}}} Aug 10 13:39:43.200316 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:39:43.200316 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:39:43.200316 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 13:39:43.200316 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 13:39:43.200316 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 13:39:43.200316 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 13:39:43.200316 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 10 13:39:43.200316 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 13:39:43.200316 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9107fc16-6a2c-48ad-8612-964c3ac05c01 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 10 13:39:43.200316 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:39:43.200316 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:39:43.200316 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:39:43.200316 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:39:43.200316 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:39:43.200316 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:39:43.200316 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:39:43.200316 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:39:43.201419 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:39:43.201419 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:39:43.201419 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 13:39:43.201419 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 13:39:43.201419 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 13:39:43.201419 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 13:39:43.201419 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 13:39:43.201419 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 13:39:43.201419 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 10 13:39:43.201419 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 10 13:39:43.201419 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 13:39:43.201419 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 13:39:43.201419 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 9107fc16-6a2c-48ad-8612-964c3ac05c01 while it is in vm_state rescued Aug 10 13:39:43.201419 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:39:43.201419 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:39:43.201419 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:39:43.201419 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:39:43.201419 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:39:43.201419 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:39:43.202435 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:39:43.202435 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:39:43.202435 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 9107fc16-6a2c-48ad-8612-964c3ac05c01 while it is in vm_state rescued Aug 10 13:39:43.202435 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:39:43.205026 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-943100fc-08d4-4d71-91f5-0ae67c078cec tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Returning 409 to user: Cannot 'attach_volume' instance 9107fc16-6a2c-48ad-8612-964c3ac05c01 while it is in vm_state rescued {{(pid=129523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:39:43.206101 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-943100fc-08d4-4d71-91f5-0ae67c078cec tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "POST /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.125777 Aug 10 13:39:43.206871 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 112/246] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 10 13:39:43 2022] POST /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01/os-volume_attachments => generated 152 bytes in 127 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 10 13:39:43.217102 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-a2b439ac-84a8-41d7-97fc-78ffea8f9dec tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:39:43.217702 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-a2b439ac-84a8-41d7-97fc-78ffea8f9dec tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 9107fc16-6a2c-48ad-8612-964c3ac05c01] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:43.225450 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a2b439ac-84a8-41d7-97fc-78ffea8f9dec tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:43.226285 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a2b439ac-84a8-41d7-97fc-78ffea8f9dec tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:43.227167 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a2b439ac-84a8-41d7-97fc-78ffea8f9dec tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:43.230083 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a2b439ac-84a8-41d7-97fc-78ffea8f9dec tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:43.230755 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a2b439ac-84a8-41d7-97fc-78ffea8f9dec tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:43.231573 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a2b439ac-84a8-41d7-97fc-78ffea8f9dec tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:43.332537 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-a2b439ac-84a8-41d7-97fc-78ffea8f9dec tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "POST /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01/action" status: 202 len: 0 microversion: 2.1 time: 0.119256 Aug 10 13:39:43.337318 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 135/247] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 10 13:39:43 2022] POST /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:39:43.349382 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-9cbe5559-e7a4-4ca7-a667-326657ea00eb tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:43.351125 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-9cbe5559-e7a4-4ca7-a667-326657ea00eb tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 9107fc16-6a2c-48ad-8612-964c3ac05c01] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:43.358840 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9cbe5559-e7a4-4ca7-a667-326657ea00eb tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:43.359455 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9cbe5559-e7a4-4ca7-a667-326657ea00eb tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:43.360047 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9cbe5559-e7a4-4ca7-a667-326657ea00eb tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:43.361205 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9cbe5559-e7a4-4ca7-a667-326657ea00eb tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:43.361696 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9cbe5559-e7a4-4ca7-a667-326657ea00eb tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:43.362122 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9cbe5559-e7a4-4ca7-a667-326657ea00eb tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:43.702626 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-9cbe5559-e7a4-4ca7-a667-326657ea00eb tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:43.717421 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-9cbe5559-e7a4-4ca7-a667-326657ea00eb tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01" status: 200 len: 1508 microversion: 2.1 time: 0.376543 Aug 10 13:39:43.718597 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 113/248] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:43 2022] GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01 => generated 1508 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:44.181293 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-3f112d83-d53a-47d6-820c-cdd9b1acf9b2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:44.182213 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-3f112d83-d53a-47d6-820c-cdd9b1acf9b2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:44.191491 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3f112d83-d53a-47d6-820c-cdd9b1acf9b2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:44.192183 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3f112d83-d53a-47d6-820c-cdd9b1acf9b2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:44.193372 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3f112d83-d53a-47d6-820c-cdd9b1acf9b2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:44.194621 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3f112d83-d53a-47d6-820c-cdd9b1acf9b2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:44.195351 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3f112d83-d53a-47d6-820c-cdd9b1acf9b2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:44.196538 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3f112d83-d53a-47d6-820c-cdd9b1acf9b2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:44.626971 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-3f112d83-d53a-47d6-820c-cdd9b1acf9b2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:44.635694 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-3f112d83-d53a-47d6-820c-cdd9b1acf9b2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:44.637342 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-3f112d83-d53a-47d6-820c-cdd9b1acf9b2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:44.639276 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-3f112d83-d53a-47d6-820c-cdd9b1acf9b2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1725 microversion: 2.20 time: 0.466498 Aug 10 13:39:44.639976 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 136/249] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:39:44 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1725 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:39:44.740425 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-b6c7e04e-4e4d-4181-abf8-1e771824cad0 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:44.741161 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-b6c7e04e-4e4d-4181-abf8-1e771824cad0 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 9107fc16-6a2c-48ad-8612-964c3ac05c01] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:44.762489 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b6c7e04e-4e4d-4181-abf8-1e771824cad0 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:44.763083 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b6c7e04e-4e4d-4181-abf8-1e771824cad0 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:44.763985 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b6c7e04e-4e4d-4181-abf8-1e771824cad0 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:44.764754 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b6c7e04e-4e4d-4181-abf8-1e771824cad0 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:44.765449 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b6c7e04e-4e4d-4181-abf8-1e771824cad0 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:44.766064 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b6c7e04e-4e4d-4181-abf8-1e771824cad0 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:44.789644 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:39:44.967309 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-b6c7e04e-4e4d-4181-abf8-1e771824cad0 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:44.980300 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-b6c7e04e-4e4d-4181-abf8-1e771824cad0 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01" status: 200 len: 1508 microversion: 2.1 time: 0.241528 Aug 10 13:39:44.980946 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 114/250] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:44 2022] GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01 => generated 1508 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:45.663315 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-eea0578b-d998-42bd-bce1-2297e7a09387 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:45.664467 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-eea0578b-d998-42bd-bce1-2297e7a09387 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:45.671512 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-eea0578b-d998-42bd-bce1-2297e7a09387 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:45.672104 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-eea0578b-d998-42bd-bce1-2297e7a09387 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:45.672755 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-eea0578b-d998-42bd-bce1-2297e7a09387 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:45.673644 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-eea0578b-d998-42bd-bce1-2297e7a09387 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:45.674201 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-eea0578b-d998-42bd-bce1-2297e7a09387 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:45.674723 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-eea0578b-d998-42bd-bce1-2297e7a09387 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:45.929371 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-eea0578b-d998-42bd-bce1-2297e7a09387 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:45.940558 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-eea0578b-d998-42bd-bce1-2297e7a09387 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:45.943644 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-eea0578b-d998-42bd-bce1-2297e7a09387 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:45.947159 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-eea0578b-d998-42bd-bce1-2297e7a09387 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1725 microversion: 2.20 time: 0.286705 Aug 10 13:39:45.948000 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 137/251] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:39:45 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1725 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:39:46.005333 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-9f0b11e8-5f80-4907-9433-44e4a7a76112 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:46.006144 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-9f0b11e8-5f80-4907-9433-44e4a7a76112 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 9107fc16-6a2c-48ad-8612-964c3ac05c01] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:46.013998 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9f0b11e8-5f80-4907-9433-44e4a7a76112 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:46.015399 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9f0b11e8-5f80-4907-9433-44e4a7a76112 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:46.016450 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9f0b11e8-5f80-4907-9433-44e4a7a76112 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:46.018423 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9f0b11e8-5f80-4907-9433-44e4a7a76112 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:46.019367 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9f0b11e8-5f80-4907-9433-44e4a7a76112 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:46.020345 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9f0b11e8-5f80-4907-9433-44e4a7a76112 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:46.337591 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-9f0b11e8-5f80-4907-9433-44e4a7a76112 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:46.347725 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-9f0b11e8-5f80-4907-9433-44e4a7a76112 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01" status: 200 len: 1508 microversion: 2.1 time: 0.349470 Aug 10 13:39:46.348315 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 115/252] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:45 2022] GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01 => generated 1508 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:46.475985 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-a47db0f7-0526-4867-879b-291aa43bd736 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:46.476574 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-a47db0f7-0526-4867-879b-291aa43bd736 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:46.484683 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a47db0f7-0526-4867-879b-291aa43bd736 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:46.485643 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a47db0f7-0526-4867-879b-291aa43bd736 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:46.486165 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a47db0f7-0526-4867-879b-291aa43bd736 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:46.486873 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a47db0f7-0526-4867-879b-291aa43bd736 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:46.489927 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a47db0f7-0526-4867-879b-291aa43bd736 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:46.491526 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a47db0f7-0526-4867-879b-291aa43bd736 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:46.525486 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-a47db0f7-0526-4867-879b-291aa43bd736 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522/ips" status: 200 len: 145 microversion: 2.1 time: 0.053223 Aug 10 13:39:46.527070 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 138/253] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Aug 10 13:39:46 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522/ips => generated 145 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:39:46.972753 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-188c7d04-3f32-447e-aa44-84cfc75a561b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:46.973510 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-188c7d04-3f32-447e-aa44-84cfc75a561b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:46.980344 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-188c7d04-3f32-447e-aa44-84cfc75a561b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:46.980993 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-188c7d04-3f32-447e-aa44-84cfc75a561b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:46.981655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-188c7d04-3f32-447e-aa44-84cfc75a561b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:46.982366 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-188c7d04-3f32-447e-aa44-84cfc75a561b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:46.982823 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-188c7d04-3f32-447e-aa44-84cfc75a561b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:46.983247 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-188c7d04-3f32-447e-aa44-84cfc75a561b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:47.206382 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-188c7d04-3f32-447e-aa44-84cfc75a561b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:47.215653 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-188c7d04-3f32-447e-aa44-84cfc75a561b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:47.217555 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-188c7d04-3f32-447e-aa44-84cfc75a561b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:47.218965 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-188c7d04-3f32-447e-aa44-84cfc75a561b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1725 microversion: 2.20 time: 0.251760 Aug 10 13:39:47.219604 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 116/254] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:39:46 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1725 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:39:47.372104 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-888d1778-9cbc-44a2-8cdc-dcfbd358cef4 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:47.372722 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-888d1778-9cbc-44a2-8cdc-dcfbd358cef4 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 9107fc16-6a2c-48ad-8612-964c3ac05c01] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:47.379523 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-888d1778-9cbc-44a2-8cdc-dcfbd358cef4 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:47.380541 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-888d1778-9cbc-44a2-8cdc-dcfbd358cef4 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:47.380978 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-888d1778-9cbc-44a2-8cdc-dcfbd358cef4 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:47.381703 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-888d1778-9cbc-44a2-8cdc-dcfbd358cef4 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:47.382167 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-888d1778-9cbc-44a2-8cdc-dcfbd358cef4 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:47.382593 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-888d1778-9cbc-44a2-8cdc-dcfbd358cef4 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:47.783565 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-bd40419d-9399-4144-a6c0-9f85c11cd2f0 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-74206450", "imageRef": "096d81df-12b1-4175-b914-babe0fa931c6", "flavorRef": "452"}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:39:47.847800 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.network.neutron [None req-bd40419d-9399-4144-a6c0-9f85c11cd2f0 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] validate_networks() for None {{(pid=129523) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:39:47.874231 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-888d1778-9cbc-44a2-8cdc-dcfbd358cef4 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:47.884322 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-888d1778-9cbc-44a2-8cdc-dcfbd358cef4 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01" status: 200 len: 1514 microversion: 2.1 time: 0.515896 Aug 10 13:39:47.885287 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 139/255] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:47 2022] GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01 => generated 1514 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:39:48.243973 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-4a222fd5-9ba4-4145-b885-c56174955b41 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:48.244796 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-4a222fd5-9ba4-4145-b885-c56174955b41 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:48.251893 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4a222fd5-9ba4-4145-b885-c56174955b41 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:48.252783 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4a222fd5-9ba4-4145-b885-c56174955b41 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:48.253455 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4a222fd5-9ba4-4145-b885-c56174955b41 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:48.254406 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4a222fd5-9ba4-4145-b885-c56174955b41 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:48.255584 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4a222fd5-9ba4-4145-b885-c56174955b41 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:48.256203 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4a222fd5-9ba4-4145-b885-c56174955b41 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:48.532237 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-4a222fd5-9ba4-4145-b885-c56174955b41 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:48.544148 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-4a222fd5-9ba4-4145-b885-c56174955b41 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:48.546668 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-4a222fd5-9ba4-4145-b885-c56174955b41 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:48.550478 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-4a222fd5-9ba4-4145-b885-c56174955b41 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1725 microversion: 2.20 time: 0.311906 Aug 10 13:39:48.553781 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 140/256] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:39:48 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1725 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:39:48.579827 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-bd40419d-9399-4144-a6c0-9f85c11cd2f0 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Flavor limits 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:39:48.580313 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-bd40419d-9399-4144-a6c0-9f85c11cd2f0 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Image limits 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:39:48.580759 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-bd40419d-9399-4144-a6c0-9f85c11cd2f0 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Flavor pref 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:39:48.581170 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-bd40419d-9399-4144-a6c0-9f85c11cd2f0 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Image pref 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:39:48.581614 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-bd40419d-9399-4144-a6c0-9f85c11cd2f0 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:39:48.591583 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bd40419d-9399-4144-a6c0-9f85c11cd2f0 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:48.592070 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bd40419d-9399-4144-a6c0-9f85c11cd2f0 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:48.592507 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bd40419d-9399-4144-a6c0-9f85c11cd2f0 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:48.593272 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bd40419d-9399-4144-a6c0-9f85c11cd2f0 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:48.597406 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bd40419d-9399-4144-a6c0-9f85c11cd2f0 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:48.597858 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bd40419d-9399-4144-a6c0-9f85c11cd2f0 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:48.622527 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-bd40419d-9399-4144-a6c0-9f85c11cd2f0 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Getting quotas for project da601c9db023410d9a12c6d7bf1eb0e0. Resources: {'cores', 'ram', 'instances'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:39:48.635126 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-bd40419d-9399-4144-a6c0-9f85c11cd2f0 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Getting quotas for user 31da32c0efe44b9f8f8ada1c11fa8fb4 and project da601c9db023410d9a12c6d7bf1eb0e0. Resources: {'cores', 'ram', 'instances'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:39:48.648609 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-bd40419d-9399-4144-a6c0-9f85c11cd2f0 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Going to run 1 instances... {{(pid=129523) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:39:48.650914 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-bd40419d-9399-4144-a6c0-9f85c11cd2f0 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] [instance: 35e80236-b69c-4206-b6a0-1565f57de305] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='096d81df-12b1-4175-b914-babe0fa931c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:39:48.723250 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-bd40419d-9399-4144-a6c0-9f85c11cd2f0 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.944394 Aug 10 13:39:48.744305 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-84db3a3a-c723-4c18-8890-b76ed34b10e0 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:48.744933 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-84db3a3a-c723-4c18-8890-b76ed34b10e0 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] [instance: 35e80236-b69c-4206-b6a0-1565f57de305] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:48.746821 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 117/257] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 10 13:39:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 968 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 13:39:48.839756 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-84db3a3a-c723-4c18-8890-b76ed34b10e0 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da32c0efe44b9f8f8ada1c11fa8fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da601c9db023410d9a12c6d7bf1eb0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:48.849662 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-84db3a3a-c723-4c18-8890-b76ed34b10e0 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] 10.222.0.52 "GET /compute/v2.1/servers/35e80236-b69c-4206-b6a0-1565f57de305" status: 200 len: 1213 microversion: 2.1 time: 0.113855 Aug 10 13:39:48.850243 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 141/258] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:48 2022] GET /compute/v2.1/servers/35e80236-b69c-4206-b6a0-1565f57de305 => generated 1213 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:48.890205 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-e7716925-12c3-42a9-adaf-b0bb07b46e97 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Action: 'create', calling method: .version_select at 0x7f49c47c78b0>, body: {"keypair": {"name": "tempest-keypair-753633501", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMn5HaKywJTrVg2+flXoNJmj/AOE2mxLwUo12+98gxa6hWi6UJtUV6CFbwepKXaqdphSmQAW/02EAbX6UGAxOUizpXrlL9qQP+qMBXAqUKBmcip5ytGKUoWa7omJq7dVg=="}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:39:48.921203 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-e7716925-12c3-42a9-adaf-b0bb07b46e97 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Getting quotas for project 48e5556cbbfd4b00aa4f6055cd6238b2. Resources: {'key_pairs'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:39:48.925892 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-e7716925-12c3-42a9-adaf-b0bb07b46e97 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Getting quotas for user a3d9e5dc719c430eac6b5c8d8b814566 and project 48e5556cbbfd4b00aa4f6055cd6238b2. Resources: {'key_pairs'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:39:48.957755 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-e7716925-12c3-42a9-adaf-b0bb07b46e97 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.073030 Aug 10 13:39:48.958546 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 118/259] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Aug 10 13:39:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:39:49.487168 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-01c99ab4-7282-49d4-a383-72e6a47fe7c3 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3635fa7e-0321-46bd-ac3f-c4dd9f6aa5c5"}} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:39:49.489155 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-ac612c73-ec45-406b-98ca-971aeb7f7467 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Action: 'create', calling method: .version_select at 0x7f49c47368b0>, body: {"keypair": {"name": "tempest-keypair-766460570", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOc+i5M8W/PnQ16Yg3OfXhuaaUdubHPcpOgo5VwlcjQ5FJedFQb+XIrY6a3pZ4psSplMU5xef+7A1jZPecDcv7XUdLQxZCGL0+1PLvrYFaIbmstgR1pSzHeU0bsXovSGVA=="}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:39:49.490480 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-01c99ab4-7282-49d4-a383-72e6a47fe7c3 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:49.502388 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-01c99ab4-7282-49d4-a383-72e6a47fe7c3 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:49.504021 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-01c99ab4-7282-49d4-a383-72e6a47fe7c3 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:49.504885 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-01c99ab4-7282-49d4-a383-72e6a47fe7c3 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:49.506516 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-01c99ab4-7282-49d4-a383-72e6a47fe7c3 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:49.507217 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-01c99ab4-7282-49d4-a383-72e6a47fe7c3 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:49.507799 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-01c99ab4-7282-49d4-a383-72e6a47fe7c3 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:49.525011 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-ac612c73-ec45-406b-98ca-971aeb7f7467 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Getting quotas for project d8eda7c7d6a348e08e81a6b2496b09e5. Resources: {'key_pairs'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:39:49.532379 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-ac612c73-ec45-406b-98ca-971aeb7f7467 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Getting quotas for user 5573338f0bd64c729c7d89345069ca6f and project d8eda7c7d6a348e08e81a6b2496b09e5. Resources: {'key_pairs'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:39:49.582137 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-ac612c73-ec45-406b-98ca-971aeb7f7467 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.098938 Aug 10 13:39:49.591891 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 119/260] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Aug 10 13:39:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:39:49.605295 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-e9b05f7b-3ed8-4e34-bcf2-9cf4673837ff tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:49.605919 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-e9b05f7b-3ed8-4e34-bcf2-9cf4673837ff tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:49.618813 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e9b05f7b-3ed8-4e34-bcf2-9cf4673837ff tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:49.619307 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e9b05f7b-3ed8-4e34-bcf2-9cf4673837ff tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:49.619737 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e9b05f7b-3ed8-4e34-bcf2-9cf4673837ff tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:49.620543 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e9b05f7b-3ed8-4e34-bcf2-9cf4673837ff tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:49.621443 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e9b05f7b-3ed8-4e34-bcf2-9cf4673837ff tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:49.621874 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e9b05f7b-3ed8-4e34-bcf2-9cf4673837ff tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:49.882792 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:39:49.915591 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-01c99ab4-7282-49d4-a383-72e6a47fe7c3 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "POST /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.433158 Aug 10 13:39:49.921938 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 142/261] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 10 13:39:49 2022] POST /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522/os-volume_attachments => generated 194 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:39:49.929550 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-e4521184-6845-4a05-bb3c-10c745c38f4d tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:49.930474 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-e4521184-6845-4a05-bb3c-10c745c38f4d tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] [instance: 35e80236-b69c-4206-b6a0-1565f57de305] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:49.939147 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e4521184-6845-4a05-bb3c-10c745c38f4d tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:49.940156 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e4521184-6845-4a05-bb3c-10c745c38f4d tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:49.941511 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e4521184-6845-4a05-bb3c-10c745c38f4d tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:49.942998 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e4521184-6845-4a05-bb3c-10c745c38f4d tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:49.943664 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e4521184-6845-4a05-bb3c-10c745c38f4d tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:49.944542 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e4521184-6845-4a05-bb3c-10c745c38f4d tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:49.990548 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-e9b05f7b-3ed8-4e34-bcf2-9cf4673837ff tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:50.001585 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-e9b05f7b-3ed8-4e34-bcf2-9cf4673837ff tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:50.002782 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-e9b05f7b-3ed8-4e34-bcf2-9cf4673837ff tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:50.009217 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-e9b05f7b-3ed8-4e34-bcf2-9cf4673837ff tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1725 microversion: 2.20 time: 0.416199 Aug 10 13:39:50.009896 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 120/262] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:39:49 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1725 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:39:50.085626 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-e4521184-6845-4a05-bb3c-10c745c38f4d tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da32c0efe44b9f8f8ada1c11fa8fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da601c9db023410d9a12c6d7bf1eb0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:50.099546 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-e4521184-6845-4a05-bb3c-10c745c38f4d tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] 10.222.0.52 "GET /compute/v2.1/servers/35e80236-b69c-4206-b6a0-1565f57de305" status: 200 len: 1265 microversion: 2.1 time: 0.175870 Aug 10 13:39:50.100364 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 143/263] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:49 2022] GET /compute/v2.1/servers/35e80236-b69c-4206-b6a0-1565f57de305 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:51.044647 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-05bee59a-67f8-41e6-977e-7654929e8197 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:51.046149 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-05bee59a-67f8-41e6-977e-7654929e8197 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:51.056569 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-05bee59a-67f8-41e6-977e-7654929e8197 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:51.072704 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-05bee59a-67f8-41e6-977e-7654929e8197 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:51.073624 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-05bee59a-67f8-41e6-977e-7654929e8197 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:51.075454 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-05bee59a-67f8-41e6-977e-7654929e8197 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:51.076312 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-05bee59a-67f8-41e6-977e-7654929e8197 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:51.090086 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-05bee59a-67f8-41e6-977e-7654929e8197 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:51.131195 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-09559e76-822b-49e7-9eb9-37aaf1e93519 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:51.131865 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-09559e76-822b-49e7-9eb9-37aaf1e93519 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] [instance: 35e80236-b69c-4206-b6a0-1565f57de305] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:51.142483 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-09559e76-822b-49e7-9eb9-37aaf1e93519 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:51.158958 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-09559e76-822b-49e7-9eb9-37aaf1e93519 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:51.159374 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-09559e76-822b-49e7-9eb9-37aaf1e93519 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:51.160179 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-09559e76-822b-49e7-9eb9-37aaf1e93519 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:51.161787 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-09559e76-822b-49e7-9eb9-37aaf1e93519 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:51.168781 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-09559e76-822b-49e7-9eb9-37aaf1e93519 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:51.250316 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-09559e76-822b-49e7-9eb9-37aaf1e93519 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da32c0efe44b9f8f8ada1c11fa8fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da601c9db023410d9a12c6d7bf1eb0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:51.263935 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-09559e76-822b-49e7-9eb9-37aaf1e93519 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] 10.222.0.52 "GET /compute/v2.1/servers/35e80236-b69c-4206-b6a0-1565f57de305" status: 200 len: 1271 microversion: 2.1 time: 0.143437 Aug 10 13:39:51.265515 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 144/264] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:51 2022] GET /compute/v2.1/servers/35e80236-b69c-4206-b6a0-1565f57de305 => generated 1271 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:51.474854 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-05bee59a-67f8-41e6-977e-7654929e8197 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:51.488682 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-05bee59a-67f8-41e6-977e-7654929e8197 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:51.490769 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-05bee59a-67f8-41e6-977e-7654929e8197 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:51.492423 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-05bee59a-67f8-41e6-977e-7654929e8197 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1725 microversion: 2.20 time: 0.453387 Aug 10 13:39:51.506203 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 121/265] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:39:51 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1725 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:39:51.889858 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-30916049-4f82-4d3e-981c-34f3076c4126 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-455382847", "imageRef": "096d81df-12b1-4175-b914-babe0fa931c6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a2798d25-3b5d-43fb-8ba3-2bd216907bcd"}], "security_groups": [{"name": "tempest-securitygroup--925085122"}], "key_name": "tempest-keypair-753633501", "user_data": "}} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:39:52.165945 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.network.neutron [None req-30916049-4f82-4d3e-981c-34f3076c4126 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] validate_networks() for [('a2798d25-3b5d-43fb-8ba3-2bd216907bcd', None, None, None, None, None)] {{(pid=129522) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:39:52.288735 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-fc96f251-1d3e-4014-8b9e-82fe2e508f99 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:52.289998 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-fc96f251-1d3e-4014-8b9e-82fe2e508f99 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] [instance: 35e80236-b69c-4206-b6a0-1565f57de305] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:52.302094 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-fc96f251-1d3e-4014-8b9e-82fe2e508f99 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:52.302890 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-fc96f251-1d3e-4014-8b9e-82fe2e508f99 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:52.304353 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-fc96f251-1d3e-4014-8b9e-82fe2e508f99 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:52.307035 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-fc96f251-1d3e-4014-8b9e-82fe2e508f99 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:52.307687 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-fc96f251-1d3e-4014-8b9e-82fe2e508f99 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:52.309457 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-fc96f251-1d3e-4014-8b9e-82fe2e508f99 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:52.616168 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-fc96f251-1d3e-4014-8b9e-82fe2e508f99 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da32c0efe44b9f8f8ada1c11fa8fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da601c9db023410d9a12c6d7bf1eb0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:52.627141 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-fc96f251-1d3e-4014-8b9e-82fe2e508f99 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] 10.222.0.52 "GET /compute/v2.1/servers/35e80236-b69c-4206-b6a0-1565f57de305" status: 200 len: 1313 microversion: 2.1 time: 0.343687 Aug 10 13:39:52.631212 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 122/266] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:52 2022] GET /compute/v2.1/servers/35e80236-b69c-4206-b6a0-1565f57de305 => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:39:52.640326 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-15476577-281d-4a0c-9072-fe9ae7991976 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:52.641286 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-15476577-281d-4a0c-9072-fe9ae7991976 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:52.654644 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-15476577-281d-4a0c-9072-fe9ae7991976 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:52.657896 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-15476577-281d-4a0c-9072-fe9ae7991976 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:52.658589 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-15476577-281d-4a0c-9072-fe9ae7991976 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:52.662050 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-15476577-281d-4a0c-9072-fe9ae7991976 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:52.662790 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-15476577-281d-4a0c-9072-fe9ae7991976 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:52.663433 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-15476577-281d-4a0c-9072-fe9ae7991976 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:52.951785 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-15476577-281d-4a0c-9072-fe9ae7991976 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:52.962740 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-15476577-281d-4a0c-9072-fe9ae7991976 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:52.964266 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-15476577-281d-4a0c-9072-fe9ae7991976 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:52.970504 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-15476577-281d-4a0c-9072-fe9ae7991976 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1725 microversion: 2.20 time: 0.336758 Aug 10 13:39:52.971106 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 123/267] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:39:52 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1725 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:39:52.982304 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-1120b9e1-d016-4b13-acdd-beff2f75dfae req-77edcd33-e49f-4ec8-b850-f3329980d6f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35e80236-b69c-4206-b6a0-1565f57de305", "tag": "5ab23a4e-ee41-4255-8aa3-10a6ffcfec91"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:39:53.006641 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-1120b9e1-d016-4b13-acdd-beff2f75dfae req-77edcd33-e49f-4ec8-b850-f3329980d6f3 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:53.007126 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-1120b9e1-d016-4b13-acdd-beff2f75dfae req-77edcd33-e49f-4ec8-b850-f3329980d6f3 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:53.007585 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-1120b9e1-d016-4b13-acdd-beff2f75dfae req-77edcd33-e49f-4ec8-b850-f3329980d6f3 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:53.028778 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-1120b9e1-d016-4b13-acdd-beff2f75dfae req-77edcd33-e49f-4ec8-b850-f3329980d6f3 service nova] Creating event network-changed:5ab23a4e-ee41-4255-8aa3-10a6ffcfec91 for instance 35e80236-b69c-4206-b6a0-1565f57de305 on hv-cinder-85200 Aug 10 13:39:53.035286 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-1120b9e1-d016-4b13-acdd-beff2f75dfae req-77edcd33-e49f-4ec8-b850-f3329980d6f3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063047 Aug 10 13:39:53.036134 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 124/268] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:39:53.660985 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-723ad576-c86d-4861-a642-f3bfeed8b8be tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:53.663699 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-723ad576-c86d-4861-a642-f3bfeed8b8be tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] [instance: 35e80236-b69c-4206-b6a0-1565f57de305] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:53.671476 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-723ad576-c86d-4861-a642-f3bfeed8b8be tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:53.672213 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-723ad576-c86d-4861-a642-f3bfeed8b8be tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:53.672802 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-723ad576-c86d-4861-a642-f3bfeed8b8be tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:53.673685 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-723ad576-c86d-4861-a642-f3bfeed8b8be tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:53.674354 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-723ad576-c86d-4861-a642-f3bfeed8b8be tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:53.674934 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-723ad576-c86d-4861-a642-f3bfeed8b8be tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:53.896020 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-723ad576-c86d-4861-a642-f3bfeed8b8be tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da32c0efe44b9f8f8ada1c11fa8fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da601c9db023410d9a12c6d7bf1eb0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:53.908318 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-723ad576-c86d-4861-a642-f3bfeed8b8be tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] 10.222.0.52 "GET /compute/v2.1/servers/35e80236-b69c-4206-b6a0-1565f57de305" status: 200 len: 1313 microversion: 2.1 time: 0.256791 Aug 10 13:39:53.909105 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 125/269] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:53 2022] GET /compute/v2.1/servers/35e80236-b69c-4206-b6a0-1565f57de305 => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:53.951016 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-6fe6f676-6ffb-4f11-bfde-444663d2df95 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1173648238", "imageRef": "096d81df-12b1-4175-b914-babe0fa931c6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c07bfdaa-43c4-49b6-bcd2-4f11035d1c09"}], "security_groups": [{"name": "tempest-securitygroup--1747379929"}], "key_name": "tempest-keypair-766460570", "user_data": "}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:39:53.962317 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.virt.hardware [None req-30916049-4f82-4d3e-981c-34f3076c4126 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Flavor limits 0:0:0 {{(pid=129522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:39:53.962836 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.virt.hardware [None req-30916049-4f82-4d3e-981c-34f3076c4126 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Image limits 0:0:0 {{(pid=129522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:39:53.963203 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.virt.hardware [None req-30916049-4f82-4d3e-981c-34f3076c4126 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Flavor pref 0:0:0 {{(pid=129522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:39:53.963617 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.virt.hardware [None req-30916049-4f82-4d3e-981c-34f3076c4126 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Image pref 0:0:0 {{(pid=129522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:39:53.964030 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.virt.hardware [None req-30916049-4f82-4d3e-981c-34f3076c4126 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:39:53.978313 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-30916049-4f82-4d3e-981c-34f3076c4126 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:53.978795 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-30916049-4f82-4d3e-981c-34f3076c4126 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:53.979225 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-30916049-4f82-4d3e-981c-34f3076c4126 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:54.002980 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-30916049-4f82-4d3e-981c-34f3076c4126 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:54.003839 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-30916049-4f82-4d3e-981c-34f3076c4126 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:54.005048 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-30916049-4f82-4d3e-981c-34f3076c4126 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:54.056046 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.quota [None req-30916049-4f82-4d3e-981c-34f3076c4126 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Getting quotas for project 48e5556cbbfd4b00aa4f6055cd6238b2. Resources: {'cores', 'ram', 'instances'} {{(pid=129522) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:39:54.060969 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.quota [None req-30916049-4f82-4d3e-981c-34f3076c4126 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Getting quotas for user a3d9e5dc719c430eac6b5c8d8b814566 and project 48e5556cbbfd4b00aa4f6055cd6238b2. Resources: {'cores', 'ram', 'instances'} {{(pid=129522) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:39:54.074263 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-30916049-4f82-4d3e-981c-34f3076c4126 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Going to run 1 instances... {{(pid=129522) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:39:54.076872 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-30916049-4f82-4d3e-981c-34f3076c4126 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 0d6055de-aea1-4e3b-9016-4c25dca9f779] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='096d81df-12b1-4175-b914-babe0fa931c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129522) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:39:54.128466 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-30916049-4f82-4d3e-981c-34f3076c4126 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.244519 Aug 10 13:39:54.129492 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 145/270] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 10 13:39:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 2247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 13:39:54.135066 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-ffe263d5-c343-454f-a6c8-a8b6cecba869 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:54.142659 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-ffe263d5-c343-454f-a6c8-a8b6cecba869 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:54.152423 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ffe263d5-c343-454f-a6c8-a8b6cecba869 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:54.152920 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ffe263d5-c343-454f-a6c8-a8b6cecba869 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:54.153383 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ffe263d5-c343-454f-a6c8-a8b6cecba869 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:54.154092 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ffe263d5-c343-454f-a6c8-a8b6cecba869 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:54.154550 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ffe263d5-c343-454f-a6c8-a8b6cecba869 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:54.154976 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ffe263d5-c343-454f-a6c8-a8b6cecba869 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:54.180349 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.network.neutron [None req-6fe6f676-6ffb-4f11-bfde-444663d2df95 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] validate_networks() for [('c07bfdaa-43c4-49b6-bcd2-4f11035d1c09', None, None, None, None, None)] {{(pid=129523) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:39:54.692456 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-ffe263d5-c343-454f-a6c8-a8b6cecba869 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:54.695955 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-6fe6f676-6ffb-4f11-bfde-444663d2df95 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Flavor limits 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:39:54.697259 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-6fe6f676-6ffb-4f11-bfde-444663d2df95 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Image limits 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:39:54.698187 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-6fe6f676-6ffb-4f11-bfde-444663d2df95 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Flavor pref 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:39:54.698758 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-6fe6f676-6ffb-4f11-bfde-444663d2df95 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Image pref 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:39:54.699426 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-6fe6f676-6ffb-4f11-bfde-444663d2df95 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:39:54.709710 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-ffe263d5-c343-454f-a6c8-a8b6cecba869 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:54.713419 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6fe6f676-6ffb-4f11-bfde-444663d2df95 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:54.714641 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6fe6f676-6ffb-4f11-bfde-444663d2df95 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:54.715741 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6fe6f676-6ffb-4f11-bfde-444663d2df95 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:54.718398 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6fe6f676-6ffb-4f11-bfde-444663d2df95 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:54.719309 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6fe6f676-6ffb-4f11-bfde-444663d2df95 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:54.719667 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-ffe263d5-c343-454f-a6c8-a8b6cecba869 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:54.720247 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6fe6f676-6ffb-4f11-bfde-444663d2df95 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:54.725868 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-ffe263d5-c343-454f-a6c8-a8b6cecba869 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1725 microversion: 2.20 time: 0.593103 Aug 10 13:39:54.744635 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 146/271] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:39:54 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1725 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:39:54.747409 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-6d8ed81d-1f3d-4f31-8d69-590d20e57037 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:54.749122 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-6d8ed81d-1f3d-4f31-8d69-590d20e57037 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 0d6055de-aea1-4e3b-9016-4c25dca9f779] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:54.778139 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-6fe6f676-6ffb-4f11-bfde-444663d2df95 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Getting quotas for project d8eda7c7d6a348e08e81a6b2496b09e5. Resources: {'cores', 'ram', 'instances'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:39:54.784157 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-6fe6f676-6ffb-4f11-bfde-444663d2df95 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Getting quotas for user 5573338f0bd64c729c7d89345069ca6f and project d8eda7c7d6a348e08e81a6b2496b09e5. Resources: {'cores', 'ram', 'instances'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:39:54.800354 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-6fe6f676-6ffb-4f11-bfde-444663d2df95 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Going to run 1 instances... {{(pid=129523) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:39:54.802954 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-6fe6f676-6ffb-4f11-bfde-444663d2df95 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='096d81df-12b1-4175-b914-babe0fa931c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:39:54.889177 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-6fe6f676-6ffb-4f11-bfde-444663d2df95 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.942615 Aug 10 13:39:54.898349 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 126/272] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 10 13:39:53 2022] POST /compute/v2.1/servers => generated 409 bytes in 952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 13:39:54.917844 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-89f755b8-4b06-479f-b928-86d9946cd028 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:54.919212 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-89f755b8-4b06-479f-b928-86d9946cd028 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:54.994828 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-6d8ed81d-1f3d-4f31-8d69-590d20e57037 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:55.004161 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-6d8ed81d-1f3d-4f31-8d69-590d20e57037 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779" status: 200 len: 1240 microversion: 2.1 time: 0.272012 Aug 10 13:39:55.018582 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 147/273] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:54 2022] GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779 => generated 1240 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:55.024314 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-44903e86-a737-4860-b5ea-655d8b7736a7 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:55.025321 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-44903e86-a737-4860-b5ea-655d8b7736a7 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] [instance: 35e80236-b69c-4206-b6a0-1565f57de305] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:55.032986 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-44903e86-a737-4860-b5ea-655d8b7736a7 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:55.033718 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-44903e86-a737-4860-b5ea-655d8b7736a7 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:55.034347 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-44903e86-a737-4860-b5ea-655d8b7736a7 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:55.035419 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-44903e86-a737-4860-b5ea-655d8b7736a7 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:55.036695 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-44903e86-a737-4860-b5ea-655d8b7736a7 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:55.037308 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-44903e86-a737-4860-b5ea-655d8b7736a7 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:55.043224 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-89f755b8-4b06-479f-b928-86d9946cd028 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:55.050855 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-89f755b8-4b06-479f-b928-86d9946cd028 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1245 microversion: 2.1 time: 0.150100 Aug 10 13:39:55.066651 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 127/274] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:54 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1245 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:55.324742 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-44903e86-a737-4860-b5ea-655d8b7736a7 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da32c0efe44b9f8f8ada1c11fa8fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da601c9db023410d9a12c6d7bf1eb0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:55.337184 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-44903e86-a737-4860-b5ea-655d8b7736a7 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] 10.222.0.52 "GET /compute/v2.1/servers/35e80236-b69c-4206-b6a0-1565f57de305" status: 200 len: 1313 microversion: 2.1 time: 0.315113 Aug 10 13:39:55.340155 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 148/275] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:55 2022] GET /compute/v2.1/servers/35e80236-b69c-4206-b6a0-1565f57de305 => generated 1313 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:55.752023 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-34dc8c8a-413c-48f1-83af-b72e74a36360 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:55.752641 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-34dc8c8a-413c-48f1-83af-b72e74a36360 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:55.756304 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:39:55.772833 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-34dc8c8a-413c-48f1-83af-b72e74a36360 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:55.773618 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-34dc8c8a-413c-48f1-83af-b72e74a36360 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:55.774211 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-34dc8c8a-413c-48f1-83af-b72e74a36360 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:55.775111 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-34dc8c8a-413c-48f1-83af-b72e74a36360 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:55.775723 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-34dc8c8a-413c-48f1-83af-b72e74a36360 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:55.776349 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-34dc8c8a-413c-48f1-83af-b72e74a36360 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:56.024830 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-d99d58db-5b17-4b53-a3d4-23ff3161c90a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:56.026190 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-d99d58db-5b17-4b53-a3d4-23ff3161c90a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 0d6055de-aea1-4e3b-9016-4c25dca9f779] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:56.035069 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d99d58db-5b17-4b53-a3d4-23ff3161c90a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:56.035572 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d99d58db-5b17-4b53-a3d4-23ff3161c90a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:56.036324 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d99d58db-5b17-4b53-a3d4-23ff3161c90a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:56.037201 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d99d58db-5b17-4b53-a3d4-23ff3161c90a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:56.037692 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d99d58db-5b17-4b53-a3d4-23ff3161c90a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:56.038124 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d99d58db-5b17-4b53-a3d4-23ff3161c90a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:56.087809 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-34dc8c8a-413c-48f1-83af-b72e74a36360 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:56.097669 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-34dc8c8a-413c-48f1-83af-b72e74a36360 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:56.099494 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-34dc8c8a-413c-48f1-83af-b72e74a36360 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:56.100966 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-34dc8c8a-413c-48f1-83af-b72e74a36360 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1725 microversion: 2.20 time: 0.352770 Aug 10 13:39:56.101762 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 128/276] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:39:55 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1725 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:39:56.107350 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-99e64c1e-eec1-4ab6-93bd-6279b654398e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:56.108303 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-99e64c1e-eec1-4ab6-93bd-6279b654398e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:56.115473 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-99e64c1e-eec1-4ab6-93bd-6279b654398e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:56.116083 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-99e64c1e-eec1-4ab6-93bd-6279b654398e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:56.116609 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-99e64c1e-eec1-4ab6-93bd-6279b654398e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:56.117457 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-99e64c1e-eec1-4ab6-93bd-6279b654398e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:56.118006 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-99e64c1e-eec1-4ab6-93bd-6279b654398e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:56.118600 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-99e64c1e-eec1-4ab6-93bd-6279b654398e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:56.128030 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-d99d58db-5b17-4b53-a3d4-23ff3161c90a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:56.139809 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-d99d58db-5b17-4b53-a3d4-23ff3161c90a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779" status: 200 len: 1300 microversion: 2.1 time: 0.119313 Aug 10 13:39:56.141040 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 149/277] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:56 2022] GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779 => generated 1300 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:39:56.359816 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-87c57591-b374-4c16-ac34-719db1c66b6e tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:56.360532 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-87c57591-b374-4c16-ac34-719db1c66b6e tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] [instance: 35e80236-b69c-4206-b6a0-1565f57de305] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:56.372361 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-87c57591-b374-4c16-ac34-719db1c66b6e tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:56.373898 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-87c57591-b374-4c16-ac34-719db1c66b6e tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:56.376294 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-87c57591-b374-4c16-ac34-719db1c66b6e tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:56.377089 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-87c57591-b374-4c16-ac34-719db1c66b6e tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:56.379170 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-87c57591-b374-4c16-ac34-719db1c66b6e tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:56.380205 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-87c57591-b374-4c16-ac34-719db1c66b6e tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:56.494734 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-99e64c1e-eec1-4ab6-93bd-6279b654398e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:56.502760 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-99e64c1e-eec1-4ab6-93bd-6279b654398e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1241 microversion: 2.1 time: 0.399171 Aug 10 13:39:56.505550 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 129/278] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:56 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1241 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:56.657190 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-87c57591-b374-4c16-ac34-719db1c66b6e tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da32c0efe44b9f8f8ada1c11fa8fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da601c9db023410d9a12c6d7bf1eb0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:56.664955 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-87c57591-b374-4c16-ac34-719db1c66b6e tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] 10.222.0.52 "GET /compute/v2.1/servers/35e80236-b69c-4206-b6a0-1565f57de305" status: 200 len: 1313 microversion: 2.1 time: 0.308845 Aug 10 13:39:56.666129 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 150/279] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:56 2022] GET /compute/v2.1/servers/35e80236-b69c-4206-b6a0-1565f57de305 => generated 1313 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:39:57.135954 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-73def710-2489-48bf-903a-6eecbe81e3ca tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:57.136560 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-73def710-2489-48bf-903a-6eecbe81e3ca tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:57.147383 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-73def710-2489-48bf-903a-6eecbe81e3ca tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:57.147894 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-73def710-2489-48bf-903a-6eecbe81e3ca tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:57.148324 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-73def710-2489-48bf-903a-6eecbe81e3ca tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:57.153563 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-73def710-2489-48bf-903a-6eecbe81e3ca tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:57.154431 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-73def710-2489-48bf-903a-6eecbe81e3ca tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:57.155654 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-73def710-2489-48bf-903a-6eecbe81e3ca tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:57.164823 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-31f2e968-3cf6-406a-93a2-3a8b43966df0 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:57.165506 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-31f2e968-3cf6-406a-93a2-3a8b43966df0 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 0d6055de-aea1-4e3b-9016-4c25dca9f779] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:57.185518 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-31f2e968-3cf6-406a-93a2-3a8b43966df0 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:57.186267 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-31f2e968-3cf6-406a-93a2-3a8b43966df0 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:57.187517 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-31f2e968-3cf6-406a-93a2-3a8b43966df0 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:57.188384 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-31f2e968-3cf6-406a-93a2-3a8b43966df0 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:57.188994 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-31f2e968-3cf6-406a-93a2-3a8b43966df0 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:57.189595 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-31f2e968-3cf6-406a-93a2-3a8b43966df0 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:57.296513 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-31f2e968-3cf6-406a-93a2-3a8b43966df0 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:57.307319 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-31f2e968-3cf6-406a-93a2-3a8b43966df0 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779" status: 200 len: 1298 microversion: 2.1 time: 0.149033 Aug 10 13:39:57.321679 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 151/280] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:57 2022] GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779 => generated 1298 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:57.414983 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-73def710-2489-48bf-903a-6eecbe81e3ca tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:57.432281 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-73def710-2489-48bf-903a-6eecbe81e3ca tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:57.433812 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-73def710-2489-48bf-903a-6eecbe81e3ca tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:57.435199 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-73def710-2489-48bf-903a-6eecbe81e3ca tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1725 microversion: 2.20 time: 0.303109 Aug 10 13:39:57.435954 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 130/281] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:39:57 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1725 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:39:57.533321 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-3fff1e3e-23df-49c6-ad00-62a78b62b872 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:57.534428 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-3fff1e3e-23df-49c6-ad00-62a78b62b872 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:57.553867 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3fff1e3e-23df-49c6-ad00-62a78b62b872 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:57.555878 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3fff1e3e-23df-49c6-ad00-62a78b62b872 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:57.557913 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3fff1e3e-23df-49c6-ad00-62a78b62b872 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:57.567143 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3fff1e3e-23df-49c6-ad00-62a78b62b872 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:57.567143 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3fff1e3e-23df-49c6-ad00-62a78b62b872 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:57.571112 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3fff1e3e-23df-49c6-ad00-62a78b62b872 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:57.686826 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-60e7d8f0-d6de-4832-803c-d27ac5ac3fce tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:57.687444 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-60e7d8f0-d6de-4832-803c-d27ac5ac3fce tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] [instance: 35e80236-b69c-4206-b6a0-1565f57de305] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:57.697201 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-60e7d8f0-d6de-4832-803c-d27ac5ac3fce tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:57.697734 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-60e7d8f0-d6de-4832-803c-d27ac5ac3fce tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:57.698355 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-60e7d8f0-d6de-4832-803c-d27ac5ac3fce tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:57.699065 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-60e7d8f0-d6de-4832-803c-d27ac5ac3fce tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:57.705896 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-60e7d8f0-d6de-4832-803c-d27ac5ac3fce tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:57.706437 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-60e7d8f0-d6de-4832-803c-d27ac5ac3fce tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:58.042784 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-3fff1e3e-23df-49c6-ad00-62a78b62b872 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:58.061162 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-3fff1e3e-23df-49c6-ad00-62a78b62b872 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1305 microversion: 2.1 time: 0.536022 Aug 10 13:39:58.063315 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 152/282] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:57 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1305 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:58.080371 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-c083880e-b4bd-432d-979e-9739094d2265 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:39:58.082053 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-60e7d8f0-d6de-4832-803c-d27ac5ac3fce tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da32c0efe44b9f8f8ada1c11fa8fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da601c9db023410d9a12c6d7bf1eb0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:58.088180 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c083880e-b4bd-432d-979e-9739094d2265 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:58.088890 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c083880e-b4bd-432d-979e-9739094d2265 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:58.089540 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c083880e-b4bd-432d-979e-9739094d2265 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:58.090875 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-60e7d8f0-d6de-4832-803c-d27ac5ac3fce tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] 10.222.0.52 "GET /compute/v2.1/servers/35e80236-b69c-4206-b6a0-1565f57de305" status: 200 len: 1313 microversion: 2.1 time: 0.408154 Aug 10 13:39:58.091449 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 131/283] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:57 2022] GET /compute/v2.1/servers/35e80236-b69c-4206-b6a0-1565f57de305 => generated 1313 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:58.183880 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-c083880e-b4bd-432d-979e-9739094d2265 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Going to try to stop instance {{(pid=129522) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 10 13:39:58.247378 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-c083880e-b4bd-432d-979e-9739094d2265 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "POST /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522/action" status: 202 len: 0 microversion: 2.1 time: 0.182601 Aug 10 13:39:58.251111 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 153/284] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 10 13:39:58 2022] POST /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:39:58.259070 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-8b77eafd-0d6f-4112-aca3-1dfbedba38f0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:58.260271 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-8b77eafd-0d6f-4112-aca3-1dfbedba38f0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:58.293158 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8b77eafd-0d6f-4112-aca3-1dfbedba38f0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:58.294127 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8b77eafd-0d6f-4112-aca3-1dfbedba38f0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:58.294761 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8b77eafd-0d6f-4112-aca3-1dfbedba38f0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:58.295664 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8b77eafd-0d6f-4112-aca3-1dfbedba38f0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:58.296360 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8b77eafd-0d6f-4112-aca3-1dfbedba38f0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:58.296966 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8b77eafd-0d6f-4112-aca3-1dfbedba38f0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:58.331588 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-eb535bb0-c125-44a7-b206-d1264912cf51 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:58.332979 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-eb535bb0-c125-44a7-b206-d1264912cf51 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 0d6055de-aea1-4e3b-9016-4c25dca9f779] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:58.347155 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-eb535bb0-c125-44a7-b206-d1264912cf51 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:58.347651 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-eb535bb0-c125-44a7-b206-d1264912cf51 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:58.354809 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-eb535bb0-c125-44a7-b206-d1264912cf51 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:58.355593 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-eb535bb0-c125-44a7-b206-d1264912cf51 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:58.356058 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-eb535bb0-c125-44a7-b206-d1264912cf51 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:58.356486 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-eb535bb0-c125-44a7-b206-d1264912cf51 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:58.615350 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-eb535bb0-c125-44a7-b206-d1264912cf51 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:58.625385 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-eb535bb0-c125-44a7-b206-d1264912cf51 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779" status: 200 len: 1365 microversion: 2.1 time: 0.300434 Aug 10 13:39:58.627184 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 154/285] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:58 2022] GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779 => generated 1365 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:39:58.635663 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-8b27ac4b-061f-475e-8de8-bbb01ec9feb6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:58.636479 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-8b27ac4b-061f-475e-8de8-bbb01ec9feb6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:58.664810 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8b27ac4b-061f-475e-8de8-bbb01ec9feb6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:58.665570 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8b27ac4b-061f-475e-8de8-bbb01ec9feb6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:58.666643 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8b27ac4b-061f-475e-8de8-bbb01ec9feb6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:58.667541 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8b27ac4b-061f-475e-8de8-bbb01ec9feb6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:58.668651 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8b27ac4b-061f-475e-8de8-bbb01ec9feb6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:58.671507 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8b27ac4b-061f-475e-8de8-bbb01ec9feb6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:58.742534 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-8b77eafd-0d6f-4112-aca3-1dfbedba38f0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:58.759975 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-8b77eafd-0d6f-4112-aca3-1dfbedba38f0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1720 microversion: 2.1 time: 0.497101 Aug 10 13:39:58.760981 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 132/286] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:58 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1720 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:58.898428 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-8b27ac4b-061f-475e-8de8-bbb01ec9feb6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:58.907623 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-8b27ac4b-061f-475e-8de8-bbb01ec9feb6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:58.909067 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-8b27ac4b-061f-475e-8de8-bbb01ec9feb6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:58.910740 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-8b27ac4b-061f-475e-8de8-bbb01ec9feb6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1725 microversion: 2.20 time: 0.282084 Aug 10 13:39:58.911993 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 155/287] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:39:58 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1725 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:39:59.083822 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-02475933-8b7f-4b26-8463-9cedca4dd20b tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:59.084462 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-02475933-8b7f-4b26-8463-9cedca4dd20b tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:59.096402 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-02475933-8b7f-4b26-8463-9cedca4dd20b tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:59.096961 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-02475933-8b7f-4b26-8463-9cedca4dd20b tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:59.099281 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-02475933-8b7f-4b26-8463-9cedca4dd20b tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:59.100069 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-02475933-8b7f-4b26-8463-9cedca4dd20b tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:59.100545 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-02475933-8b7f-4b26-8463-9cedca4dd20b tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:59.101060 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-02475933-8b7f-4b26-8463-9cedca4dd20b tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:59.112386 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-5484eb36-dad1-4ee4-8ff5-f2ebea1eae5d tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:59.113275 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-5484eb36-dad1-4ee4-8ff5-f2ebea1eae5d tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] [instance: 35e80236-b69c-4206-b6a0-1565f57de305] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:59.123955 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5484eb36-dad1-4ee4-8ff5-f2ebea1eae5d tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:59.124934 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5484eb36-dad1-4ee4-8ff5-f2ebea1eae5d tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:59.125590 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5484eb36-dad1-4ee4-8ff5-f2ebea1eae5d tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:59.126630 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5484eb36-dad1-4ee4-8ff5-f2ebea1eae5d tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:59.129265 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5484eb36-dad1-4ee4-8ff5-f2ebea1eae5d tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:59.130484 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5484eb36-dad1-4ee4-8ff5-f2ebea1eae5d tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:59.312454 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-02475933-8b7f-4b26-8463-9cedca4dd20b tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:59.322613 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-02475933-8b7f-4b26-8463-9cedca4dd20b tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1303 microversion: 2.1 time: 0.243014 Aug 10 13:39:59.323580 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 133/288] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:59 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1303 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:59.326983 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-5484eb36-dad1-4ee4-8ff5-f2ebea1eae5d tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da32c0efe44b9f8f8ada1c11fa8fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da601c9db023410d9a12c6d7bf1eb0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:59.328433 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-f195a38c-8d4e-4723-97f1-fa274f0ed133 req-b4fe7211-f052-40d9-bf67-6bf633017b9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35e80236-b69c-4206-b6a0-1565f57de305", "name": "network-vif-plugged", "status": "completed", "tag": "5ab23a4e-ee41-4255-8aa3-10a6ffcfec91"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:39:59.344954 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-5484eb36-dad1-4ee4-8ff5-f2ebea1eae5d tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] 10.222.0.52 "GET /compute/v2.1/servers/35e80236-b69c-4206-b6a0-1565f57de305" status: 200 len: 1313 microversion: 2.1 time: 0.236764 Aug 10 13:39:59.345748 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-f195a38c-8d4e-4723-97f1-fa274f0ed133 req-b4fe7211-f052-40d9-bf67-6bf633017b9e service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:59.346233 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-f195a38c-8d4e-4723-97f1-fa274f0ed133 req-b4fe7211-f052-40d9-bf67-6bf633017b9e service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:59.346663 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-f195a38c-8d4e-4723-97f1-fa274f0ed133 req-b4fe7211-f052-40d9-bf67-6bf633017b9e service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:59.366661 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 156/289] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:59 2022] GET /compute/v2.1/servers/35e80236-b69c-4206-b6a0-1565f57de305 => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:39:59.368921 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-f195a38c-8d4e-4723-97f1-fa274f0ed133 req-b4fe7211-f052-40d9-bf67-6bf633017b9e service nova] Creating event network-vif-plugged:5ab23a4e-ee41-4255-8aa3-10a6ffcfec91 for instance 35e80236-b69c-4206-b6a0-1565f57de305 on hv-cinder-85200 Aug 10 13:39:59.374275 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-f195a38c-8d4e-4723-97f1-fa274f0ed133 req-b4fe7211-f052-40d9-bf67-6bf633017b9e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049429 Aug 10 13:39:59.374866 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 134/290] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:39:59.650041 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-067e38d6-3334-4342-bca6-f0d0ba0e60b7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:59.651187 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-067e38d6-3334-4342-bca6-f0d0ba0e60b7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 0d6055de-aea1-4e3b-9016-4c25dca9f779] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:59.661697 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-067e38d6-3334-4342-bca6-f0d0ba0e60b7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:59.662923 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-067e38d6-3334-4342-bca6-f0d0ba0e60b7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:59.663586 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-067e38d6-3334-4342-bca6-f0d0ba0e60b7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:59.664863 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-067e38d6-3334-4342-bca6-f0d0ba0e60b7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:59.665519 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-067e38d6-3334-4342-bca6-f0d0ba0e60b7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:59.667607 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-067e38d6-3334-4342-bca6-f0d0ba0e60b7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:59.791329 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-e36122df-cf78-4363-8306-6436c291b979 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:59.792883 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-e36122df-cf78-4363-8306-6436c291b979 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:59.822251 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e36122df-cf78-4363-8306-6436c291b979 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:59.827577 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e36122df-cf78-4363-8306-6436c291b979 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:59.828263 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e36122df-cf78-4363-8306-6436c291b979 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:59.829189 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e36122df-cf78-4363-8306-6436c291b979 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:59.829839 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e36122df-cf78-4363-8306-6436c291b979 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:59.830426 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e36122df-cf78-4363-8306-6436c291b979 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:59.888223 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-067e38d6-3334-4342-bca6-f0d0ba0e60b7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:39:59.899094 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-067e38d6-3334-4342-bca6-f0d0ba0e60b7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779" status: 200 len: 1365 microversion: 2.1 time: 0.254765 Aug 10 13:39:59.903253 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 157/291] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:59 2022] GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779 => generated 1365 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:39:59.936973 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-4edc4115-aee6-4b45-88ea-57ea198716b3 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:39:59.938116 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-4edc4115-aee6-4b45-88ea-57ea198716b3 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:39:59.947997 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4edc4115-aee6-4b45-88ea-57ea198716b3 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:59.949447 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4edc4115-aee6-4b45-88ea-57ea198716b3 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:59.953479 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4edc4115-aee6-4b45-88ea-57ea198716b3 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:39:59.954442 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4edc4115-aee6-4b45-88ea-57ea198716b3 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:39:59.955709 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4edc4115-aee6-4b45-88ea-57ea198716b3 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:39:59.957989 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4edc4115-aee6-4b45-88ea-57ea198716b3 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:00.272637 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-e36122df-cf78-4363-8306-6436c291b979 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:00.290374 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-e36122df-cf78-4363-8306-6436c291b979 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1720 microversion: 2.1 time: 0.507678 Aug 10 13:40:00.290984 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 135/292] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:39:59 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1720 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:00.295580 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-802d9a9b-16eb-4dd7-a6ad-0f48d3ba9cf3 req-8abda695-ae32-47d2-accd-e7777359aa00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d6055de-aea1-4e3b-9016-4c25dca9f779", "tag": "609518cd-9119-4805-aafe-d15f58ca5d2b"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:40:00.348375 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-4edc4115-aee6-4b45-88ea-57ea198716b3 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:00.357623 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-4edc4115-aee6-4b45-88ea-57ea198716b3 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:00.357814 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-802d9a9b-16eb-4dd7-a6ad-0f48d3ba9cf3 req-8abda695-ae32-47d2-accd-e7777359aa00 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:00.358246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-802d9a9b-16eb-4dd7-a6ad-0f48d3ba9cf3 req-8abda695-ae32-47d2-accd-e7777359aa00 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:00.358630 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-802d9a9b-16eb-4dd7-a6ad-0f48d3ba9cf3 req-8abda695-ae32-47d2-accd-e7777359aa00 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:00.363034 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-4edc4115-aee6-4b45-88ea-57ea198716b3 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:00.364289 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-4edc4115-aee6-4b45-88ea-57ea198716b3 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1725 microversion: 2.20 time: 0.433183 Aug 10 13:40:00.365181 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 158/293] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:39:59 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1725 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:40:00.389761 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-7e79d3e2-12ea-4ae9-af67-8142a4478994 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:00.390372 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-7e79d3e2-12ea-4ae9-af67-8142a4478994 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:00.392372 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-802d9a9b-16eb-4dd7-a6ad-0f48d3ba9cf3 req-8abda695-ae32-47d2-accd-e7777359aa00 service nova] Creating event network-changed:609518cd-9119-4805-aafe-d15f58ca5d2b for instance 0d6055de-aea1-4e3b-9016-4c25dca9f779 on hv-cinder-85200 Aug 10 13:40:00.398146 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7e79d3e2-12ea-4ae9-af67-8142a4478994 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:00.398887 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7e79d3e2-12ea-4ae9-af67-8142a4478994 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:00.399506 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7e79d3e2-12ea-4ae9-af67-8142a4478994 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:00.402236 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7e79d3e2-12ea-4ae9-af67-8142a4478994 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:00.402966 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7e79d3e2-12ea-4ae9-af67-8142a4478994 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:00.404594 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7e79d3e2-12ea-4ae9-af67-8142a4478994 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:00.416149 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-802d9a9b-16eb-4dd7-a6ad-0f48d3ba9cf3 req-8abda695-ae32-47d2-accd-e7777359aa00 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123921 Aug 10 13:40:00.419895 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 136/294] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:40:00.427772 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-ef9ed440-a2a9-409f-adc7-09df40b78491 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:00.428686 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-ef9ed440-a2a9-409f-adc7-09df40b78491 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] [instance: 35e80236-b69c-4206-b6a0-1565f57de305] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:00.435215 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ef9ed440-a2a9-409f-adc7-09df40b78491 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:00.435521 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ef9ed440-a2a9-409f-adc7-09df40b78491 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:00.436644 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ef9ed440-a2a9-409f-adc7-09df40b78491 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:00.437728 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ef9ed440-a2a9-409f-adc7-09df40b78491 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:00.438358 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ef9ed440-a2a9-409f-adc7-09df40b78491 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:00.438927 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ef9ed440-a2a9-409f-adc7-09df40b78491 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:00.468395 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell1:SELECT=100 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:40:00.661998 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-7e79d3e2-12ea-4ae9-af67-8142a4478994 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:00.666122 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:40:00.675434 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-7e79d3e2-12ea-4ae9-af67-8142a4478994 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1371 microversion: 2.1 time: 0.289457 Aug 10 13:40:00.678100 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 159/295] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:00 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1371 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:00.930148 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-c2c104b9-b967-4258-9004-7b3db1c49f60 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:00.930787 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-c2c104b9-b967-4258-9004-7b3db1c49f60 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 0d6055de-aea1-4e3b-9016-4c25dca9f779] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:00.963844 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c2c104b9-b967-4258-9004-7b3db1c49f60 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:00.964383 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c2c104b9-b967-4258-9004-7b3db1c49f60 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:00.968300 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c2c104b9-b967-4258-9004-7b3db1c49f60 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:00.970502 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c2c104b9-b967-4258-9004-7b3db1c49f60 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:00.974243 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c2c104b9-b967-4258-9004-7b3db1c49f60 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:00.974914 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c2c104b9-b967-4258-9004-7b3db1c49f60 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:01.001926 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-ef9ed440-a2a9-409f-adc7-09df40b78491 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da32c0efe44b9f8f8ada1c11fa8fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da601c9db023410d9a12c6d7bf1eb0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:01.010331 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-ef9ed440-a2a9-409f-adc7-09df40b78491 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] 10.222.0.52 "GET /compute/v2.1/servers/35e80236-b69c-4206-b6a0-1565f57de305" status: 200 len: 1313 microversion: 2.1 time: 0.588643 Aug 10 13:40:01.016535 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 137/296] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:00 2022] GET /compute/v2.1/servers/35e80236-b69c-4206-b6a0-1565f57de305 => generated 1313 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:01.199618 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-c2c104b9-b967-4258-9004-7b3db1c49f60 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:01.211486 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-c2c104b9-b967-4258-9004-7b3db1c49f60 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779" status: 200 len: 1365 microversion: 2.1 time: 0.287353 Aug 10 13:40:01.212078 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 160/297] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:00 2022] GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779 => generated 1365 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:01.311926 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-a40c13fc-20f2-4588-9f19-c54127f326d8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:01.312540 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-a40c13fc-20f2-4588-9f19-c54127f326d8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:01.319812 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a40c13fc-20f2-4588-9f19-c54127f326d8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:01.320301 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a40c13fc-20f2-4588-9f19-c54127f326d8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:01.322763 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a40c13fc-20f2-4588-9f19-c54127f326d8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:01.322763 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a40c13fc-20f2-4588-9f19-c54127f326d8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:01.322763 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a40c13fc-20f2-4588-9f19-c54127f326d8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:01.322763 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a40c13fc-20f2-4588-9f19-c54127f326d8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:01.391552 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-a998845a-eb87-467b-9710-c5d855f68e80 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:01.393221 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-a998845a-eb87-467b-9710-c5d855f68e80 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:01.400599 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a998845a-eb87-467b-9710-c5d855f68e80 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:01.401431 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a998845a-eb87-467b-9710-c5d855f68e80 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:01.402049 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a998845a-eb87-467b-9710-c5d855f68e80 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:01.404267 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a998845a-eb87-467b-9710-c5d855f68e80 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:01.404728 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a998845a-eb87-467b-9710-c5d855f68e80 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:01.405146 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a998845a-eb87-467b-9710-c5d855f68e80 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:01.608281 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-a998845a-eb87-467b-9710-c5d855f68e80 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:01.622580 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-a998845a-eb87-467b-9710-c5d855f68e80 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:01.624360 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-a998845a-eb87-467b-9710-c5d855f68e80 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:01.625721 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-a998845a-eb87-467b-9710-c5d855f68e80 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1725 microversion: 2.20 time: 0.238050 Aug 10 13:40:01.640743 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 161/298] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:01 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1725 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:40:01.646127 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-a40c13fc-20f2-4588-9f19-c54127f326d8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:01.679653 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-a40c13fc-20f2-4588-9f19-c54127f326d8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1720 microversion: 2.1 time: 0.371437 Aug 10 13:40:01.680413 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 138/299] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:01 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1720 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:01.699531 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-e5274e58-4d66-45a9-a538-c89ca0da454a tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:01.700302 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-e5274e58-4d66-45a9-a538-c89ca0da454a tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:01.717139 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e5274e58-4d66-45a9-a538-c89ca0da454a tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:01.717880 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e5274e58-4d66-45a9-a538-c89ca0da454a tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:01.718299 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e5274e58-4d66-45a9-a538-c89ca0da454a tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:01.719000 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e5274e58-4d66-45a9-a538-c89ca0da454a tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:01.719507 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e5274e58-4d66-45a9-a538-c89ca0da454a tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:01.719989 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e5274e58-4d66-45a9-a538-c89ca0da454a tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:01.890422 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-e5274e58-4d66-45a9-a538-c89ca0da454a tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:01.900613 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-e5274e58-4d66-45a9-a538-c89ca0da454a tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1371 microversion: 2.1 time: 0.205756 Aug 10 13:40:01.901862 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 162/300] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:01 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1371 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:02.036463 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-4ed4b726-be08-497f-8b72-3cdcfb921428 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:02.037078 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-4ed4b726-be08-497f-8b72-3cdcfb921428 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] [instance: 35e80236-b69c-4206-b6a0-1565f57de305] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:02.052528 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4ed4b726-be08-497f-8b72-3cdcfb921428 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:02.053015 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4ed4b726-be08-497f-8b72-3cdcfb921428 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:02.053471 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4ed4b726-be08-497f-8b72-3cdcfb921428 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:02.054171 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4ed4b726-be08-497f-8b72-3cdcfb921428 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:02.054626 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4ed4b726-be08-497f-8b72-3cdcfb921428 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:02.055047 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4ed4b726-be08-497f-8b72-3cdcfb921428 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:02.232301 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-4e144287-e8c3-453e-a97f-83a3ce4ca3d9 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:02.232728 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-4e144287-e8c3-453e-a97f-83a3ce4ca3d9 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 0d6055de-aea1-4e3b-9016-4c25dca9f779] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:02.239557 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4e144287-e8c3-453e-a97f-83a3ce4ca3d9 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:02.240111 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4e144287-e8c3-453e-a97f-83a3ce4ca3d9 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:02.240544 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4e144287-e8c3-453e-a97f-83a3ce4ca3d9 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:02.241250 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4e144287-e8c3-453e-a97f-83a3ce4ca3d9 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:02.241704 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4e144287-e8c3-453e-a97f-83a3ce4ca3d9 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:02.242121 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4e144287-e8c3-453e-a97f-83a3ce4ca3d9 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:02.283876 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-4ed4b726-be08-497f-8b72-3cdcfb921428 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da32c0efe44b9f8f8ada1c11fa8fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da601c9db023410d9a12c6d7bf1eb0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:02.295332 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-4ed4b726-be08-497f-8b72-3cdcfb921428 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] 10.222.0.52 "GET /compute/v2.1/servers/35e80236-b69c-4206-b6a0-1565f57de305" status: 200 len: 1463 microversion: 2.1 time: 0.263216 Aug 10 13:40:02.305274 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 139/301] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:02 2022] GET /compute/v2.1/servers/35e80236-b69c-4206-b6a0-1565f57de305 => generated 1463 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:02.367780 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-444ed297-03cd-4242-8dfc-1c70c7984705 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:02.368559 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-444ed297-03cd-4242-8dfc-1c70c7984705 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] [instance: 35e80236-b69c-4206-b6a0-1565f57de305] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:02.381372 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-444ed297-03cd-4242-8dfc-1c70c7984705 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:02.382027 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-444ed297-03cd-4242-8dfc-1c70c7984705 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:02.384497 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-444ed297-03cd-4242-8dfc-1c70c7984705 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:02.385362 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-444ed297-03cd-4242-8dfc-1c70c7984705 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:02.385934 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-444ed297-03cd-4242-8dfc-1c70c7984705 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:02.388211 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-444ed297-03cd-4242-8dfc-1c70c7984705 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:02.455670 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-444ed297-03cd-4242-8dfc-1c70c7984705 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] [instance: 35e80236-b69c-4206-b6a0-1565f57de305] Going to try to terminate instance {{(pid=129523) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:40:02.469315 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-4e144287-e8c3-453e-a97f-83a3ce4ca3d9 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:02.480234 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-4e144287-e8c3-453e-a97f-83a3ce4ca3d9 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779" status: 200 len: 1365 microversion: 2.1 time: 0.249741 Aug 10 13:40:02.481295 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 163/302] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:02 2022] GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779 => generated 1365 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:40:02.494124 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-a97ac7ac-13ad-47c8-be4f-28b91649e1c5 req-bb729301-7c4f-48a5-a021-038318176e2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51cd434d-31c3-4588-aed7-48e7130c5131", "tag": "514f1eb9-5330-47e3-b4c5-db965c497335"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:40:02.523232 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-a97ac7ac-13ad-47c8-be4f-28b91649e1c5 req-bb729301-7c4f-48a5-a021-038318176e2f service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:02.523999 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-a97ac7ac-13ad-47c8-be4f-28b91649e1c5 req-bb729301-7c4f-48a5-a021-038318176e2f service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:02.524906 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-a97ac7ac-13ad-47c8-be4f-28b91649e1c5 req-bb729301-7c4f-48a5-a021-038318176e2f service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:02.551505 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-a97ac7ac-13ad-47c8-be4f-28b91649e1c5 req-bb729301-7c4f-48a5-a021-038318176e2f service nova] Creating event network-changed:514f1eb9-5330-47e3-b4c5-db965c497335 for instance 51cd434d-31c3-4588-aed7-48e7130c5131 on hv-cinder-85200 Aug 10 13:40:02.557093 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-a97ac7ac-13ad-47c8-be4f-28b91649e1c5 req-bb729301-7c4f-48a5-a021-038318176e2f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072073 Aug 10 13:40:02.558160 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 164/303] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:40:02.588324 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-444ed297-03cd-4242-8dfc-1c70c7984705 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] 10.222.0.52 "DELETE /compute/v2.1/servers/35e80236-b69c-4206-b6a0-1565f57de305" status: 204 len: 0 microversion: 2.1 time: 0.225068 Aug 10 13:40:02.589941 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 140/304] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 10 13:40:02 2022] DELETE /compute/v2.1/servers/35e80236-b69c-4206-b6a0-1565f57de305 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:40:02.600858 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-0f4ffd98-9f21-43d8-9ef3-e4ab5fc5766f tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:02.601759 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-0f4ffd98-9f21-43d8-9ef3-e4ab5fc5766f tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] [instance: 35e80236-b69c-4206-b6a0-1565f57de305] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:02.612008 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0f4ffd98-9f21-43d8-9ef3-e4ab5fc5766f tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:02.612505 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0f4ffd98-9f21-43d8-9ef3-e4ab5fc5766f tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:02.615542 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0f4ffd98-9f21-43d8-9ef3-e4ab5fc5766f tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:02.616274 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0f4ffd98-9f21-43d8-9ef3-e4ab5fc5766f tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:02.616737 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0f4ffd98-9f21-43d8-9ef3-e4ab5fc5766f tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:02.618695 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0f4ffd98-9f21-43d8-9ef3-e4ab5fc5766f tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:02.653757 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-92c1fae7-29c7-44a1-b365-146fab06a17b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:02.654460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-92c1fae7-29c7-44a1-b365-146fab06a17b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:02.666094 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-92c1fae7-29c7-44a1-b365-146fab06a17b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:02.673965 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-92c1fae7-29c7-44a1-b365-146fab06a17b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:02.676783 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-92c1fae7-29c7-44a1-b365-146fab06a17b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:02.679470 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-92c1fae7-29c7-44a1-b365-146fab06a17b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:02.682399 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-92c1fae7-29c7-44a1-b365-146fab06a17b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:02.683155 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-92c1fae7-29c7-44a1-b365-146fab06a17b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:02.802105 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-0f4ffd98-9f21-43d8-9ef3-e4ab5fc5766f tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da32c0efe44b9f8f8ada1c11fa8fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da601c9db023410d9a12c6d7bf1eb0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:02.811471 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-0f4ffd98-9f21-43d8-9ef3-e4ab5fc5766f tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] 10.222.0.52 "GET /compute/v2.1/servers/35e80236-b69c-4206-b6a0-1565f57de305" status: 200 len: 1469 microversion: 2.1 time: 0.215019 Aug 10 13:40:02.812466 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 165/305] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:02 2022] GET /compute/v2.1/servers/35e80236-b69c-4206-b6a0-1565f57de305 => generated 1469 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:02.820172 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-ef3742b4-9d52-4a53-be99-04f1ab08f258 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:02.820804 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-ef3742b4-9d52-4a53-be99-04f1ab08f258 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:02.830801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ef3742b4-9d52-4a53-be99-04f1ab08f258 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:02.831622 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ef3742b4-9d52-4a53-be99-04f1ab08f258 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:02.832487 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ef3742b4-9d52-4a53-be99-04f1ab08f258 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:02.833475 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ef3742b4-9d52-4a53-be99-04f1ab08f258 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:02.834164 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ef3742b4-9d52-4a53-be99-04f1ab08f258 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:02.834837 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ef3742b4-9d52-4a53-be99-04f1ab08f258 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:02.947103 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-92c1fae7-29c7-44a1-b365-146fab06a17b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:02.959458 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-92c1fae7-29c7-44a1-b365-146fab06a17b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:02.961682 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-92c1fae7-29c7-44a1-b365-146fab06a17b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:02.963139 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-92c1fae7-29c7-44a1-b365-146fab06a17b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1725 microversion: 2.20 time: 0.314953 Aug 10 13:40:02.964250 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 141/306] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:02 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1725 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:40:02.969107 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-1f16612e-71de-4360-854a-e3aacabc57fd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:02.970075 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-1f16612e-71de-4360-854a-e3aacabc57fd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:02.976708 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1f16612e-71de-4360-854a-e3aacabc57fd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:02.977676 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1f16612e-71de-4360-854a-e3aacabc57fd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:02.978357 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1f16612e-71de-4360-854a-e3aacabc57fd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:02.979301 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1f16612e-71de-4360-854a-e3aacabc57fd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:02.980415 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1f16612e-71de-4360-854a-e3aacabc57fd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:02.981059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1f16612e-71de-4360-854a-e3aacabc57fd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:03.009710 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-ef3742b4-9d52-4a53-be99-04f1ab08f258 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:03.018415 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-ef3742b4-9d52-4a53-be99-04f1ab08f258 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1720 microversion: 2.1 time: 0.204782 Aug 10 13:40:03.019176 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 166/307] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:02 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1720 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:03.181989 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-1f16612e-71de-4360-854a-e3aacabc57fd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:03.198093 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-1f16612e-71de-4360-854a-e3aacabc57fd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1371 microversion: 2.1 time: 0.232558 Aug 10 13:40:03.198677 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 142/308] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:02 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1371 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:03.521560 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-3b1893dc-8a94-4c0a-aa86-89ca3dd0f33b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:03.521560 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-3b1893dc-8a94-4c0a-aa86-89ca3dd0f33b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 0d6055de-aea1-4e3b-9016-4c25dca9f779] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:03.522523 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3b1893dc-8a94-4c0a-aa86-89ca3dd0f33b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:03.522616 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3b1893dc-8a94-4c0a-aa86-89ca3dd0f33b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:03.523061 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3b1893dc-8a94-4c0a-aa86-89ca3dd0f33b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:03.525759 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3b1893dc-8a94-4c0a-aa86-89ca3dd0f33b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:03.525759 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3b1893dc-8a94-4c0a-aa86-89ca3dd0f33b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:03.525759 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3b1893dc-8a94-4c0a-aa86-89ca3dd0f33b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:03.697879 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-3b1893dc-8a94-4c0a-aa86-89ca3dd0f33b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:03.705402 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-3b1893dc-8a94-4c0a-aa86-89ca3dd0f33b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779" status: 200 len: 1365 microversion: 2.1 time: 0.194663 Aug 10 13:40:03.706072 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 167/309] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:03 2022] GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779 => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:03.838782 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-e61bed35-5696-49a6-bcde-e3445e6902cc tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:03.840067 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-e61bed35-5696-49a6-bcde-e3445e6902cc tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] [instance: 35e80236-b69c-4206-b6a0-1565f57de305] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:03.847007 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e61bed35-5696-49a6-bcde-e3445e6902cc tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:03.847486 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e61bed35-5696-49a6-bcde-e3445e6902cc tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:03.848179 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e61bed35-5696-49a6-bcde-e3445e6902cc tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:03.849044 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e61bed35-5696-49a6-bcde-e3445e6902cc tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:03.849672 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e61bed35-5696-49a6-bcde-e3445e6902cc tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:03.850248 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e61bed35-5696-49a6-bcde-e3445e6902cc tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:03.989446 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-7f6343c0-9961-4a11-960b-640280a0c027 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:03.990221 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-7f6343c0-9961-4a11-960b-640280a0c027 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:03.996836 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7f6343c0-9961-4a11-960b-640280a0c027 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:03.997353 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7f6343c0-9961-4a11-960b-640280a0c027 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:03.997806 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7f6343c0-9961-4a11-960b-640280a0c027 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:03.998484 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7f6343c0-9961-4a11-960b-640280a0c027 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:04.002222 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7f6343c0-9961-4a11-960b-640280a0c027 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:04.005543 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7f6343c0-9961-4a11-960b-640280a0c027 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:04.024192 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell0:SELECT=2 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:40:04.045817 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-e61bed35-5696-49a6-bcde-e3445e6902cc tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da32c0efe44b9f8f8ada1c11fa8fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da601c9db023410d9a12c6d7bf1eb0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:04.056231 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-e61bed35-5696-49a6-bcde-e3445e6902cc tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] 10.222.0.52 "GET /compute/v2.1/servers/35e80236-b69c-4206-b6a0-1565f57de305" status: 200 len: 1469 microversion: 2.1 time: 0.221164 Aug 10 13:40:04.057662 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 143/310] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:03 2022] GET /compute/v2.1/servers/35e80236-b69c-4206-b6a0-1565f57de305 => generated 1469 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:04.065690 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-e782066f-f263-4422-8157-7014371730dc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:04.066554 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-e782066f-f263-4422-8157-7014371730dc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:04.078714 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e782066f-f263-4422-8157-7014371730dc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:04.079459 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e782066f-f263-4422-8157-7014371730dc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:04.081652 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e782066f-f263-4422-8157-7014371730dc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:04.083516 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e782066f-f263-4422-8157-7014371730dc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:04.085842 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e782066f-f263-4422-8157-7014371730dc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:04.086455 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e782066f-f263-4422-8157-7014371730dc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:04.255965 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-7f6343c0-9961-4a11-960b-640280a0c027 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:04.266299 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-7f6343c0-9961-4a11-960b-640280a0c027 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:04.268251 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-7f6343c0-9961-4a11-960b-640280a0c027 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:04.269642 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-7f6343c0-9961-4a11-960b-640280a0c027 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1725 microversion: 2.20 time: 0.284372 Aug 10 13:40:04.289167 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-e782066f-f263-4422-8157-7014371730dc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:04.289867 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 168/311] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:03 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1725 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:40:04.298913 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-39e98e70-5a4b-41f7-bfec-258f09e4c40c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:04.299541 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-39e98e70-5a4b-41f7-bfec-258f09e4c40c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:04.302205 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-e782066f-f263-4422-8157-7014371730dc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1720 microversion: 2.1 time: 0.238759 Aug 10 13:40:04.313270 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 144/312] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:04 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1720 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:04.313493 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-39e98e70-5a4b-41f7-bfec-258f09e4c40c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:04.313493 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-39e98e70-5a4b-41f7-bfec-258f09e4c40c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:04.313493 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-39e98e70-5a4b-41f7-bfec-258f09e4c40c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:04.313493 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-39e98e70-5a4b-41f7-bfec-258f09e4c40c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:04.313805 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-39e98e70-5a4b-41f7-bfec-258f09e4c40c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:04.313805 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-39e98e70-5a4b-41f7-bfec-258f09e4c40c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:04.535199 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-39e98e70-5a4b-41f7-bfec-258f09e4c40c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:04.544491 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-39e98e70-5a4b-41f7-bfec-258f09e4c40c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1371 microversion: 2.1 time: 0.253627 Aug 10 13:40:04.545543 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 169/313] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:04 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1371 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:04.727704 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-77ec07ae-55fc-48b6-a3eb-1e494cf79d77 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:04.728233 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-77ec07ae-55fc-48b6-a3eb-1e494cf79d77 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 0d6055de-aea1-4e3b-9016-4c25dca9f779] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:04.739507 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-77ec07ae-55fc-48b6-a3eb-1e494cf79d77 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:04.740022 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-77ec07ae-55fc-48b6-a3eb-1e494cf79d77 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:04.740453 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-77ec07ae-55fc-48b6-a3eb-1e494cf79d77 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:04.741164 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-77ec07ae-55fc-48b6-a3eb-1e494cf79d77 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:04.741670 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-77ec07ae-55fc-48b6-a3eb-1e494cf79d77 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:04.742102 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-77ec07ae-55fc-48b6-a3eb-1e494cf79d77 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:04.749556 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell0:SELECT=4 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:40:04.940908 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-77ec07ae-55fc-48b6-a3eb-1e494cf79d77 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:04.952850 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-77ec07ae-55fc-48b6-a3eb-1e494cf79d77 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779" status: 200 len: 1365 microversion: 2.1 time: 0.229727 Aug 10 13:40:04.959856 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 145/314] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:04 2022] GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779 => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:05.077722 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-d84c1d75-8545-45fe-87e8-9f8d7024d1b6 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:05.078637 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-d84c1d75-8545-45fe-87e8-9f8d7024d1b6 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] [instance: 35e80236-b69c-4206-b6a0-1565f57de305] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:05.080879 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell0:SELECT=10 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:40:05.089468 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d84c1d75-8545-45fe-87e8-9f8d7024d1b6 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:05.090090 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d84c1d75-8545-45fe-87e8-9f8d7024d1b6 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:05.090619 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d84c1d75-8545-45fe-87e8-9f8d7024d1b6 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:05.091416 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d84c1d75-8545-45fe-87e8-9f8d7024d1b6 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:05.091967 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d84c1d75-8545-45fe-87e8-9f8d7024d1b6 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:05.094814 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d84c1d75-8545-45fe-87e8-9f8d7024d1b6 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:05.243273 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-d84c1d75-8545-45fe-87e8-9f8d7024d1b6 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da32c0efe44b9f8f8ada1c11fa8fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da601c9db023410d9a12c6d7bf1eb0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:05.250908 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-d84c1d75-8545-45fe-87e8-9f8d7024d1b6 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] 10.222.0.52 "GET /compute/v2.1/servers/35e80236-b69c-4206-b6a0-1565f57de305" status: 200 len: 1469 microversion: 2.1 time: 0.176898 Aug 10 13:40:05.266085 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 170/315] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:05 2022] GET /compute/v2.1/servers/35e80236-b69c-4206-b6a0-1565f57de305 => generated 1469 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:05.296874 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-f06f4e94-ca6e-47c6-9d05-3f2a86bf0106 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:05.297536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-f06f4e94-ca6e-47c6-9d05-3f2a86bf0106 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:05.299673 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell0:SELECT=22 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:40:05.304927 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f06f4e94-ca6e-47c6-9d05-3f2a86bf0106 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:05.305644 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f06f4e94-ca6e-47c6-9d05-3f2a86bf0106 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:05.306397 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f06f4e94-ca6e-47c6-9d05-3f2a86bf0106 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:05.307301 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f06f4e94-ca6e-47c6-9d05-3f2a86bf0106 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:05.307758 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f06f4e94-ca6e-47c6-9d05-3f2a86bf0106 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:05.308487 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f06f4e94-ca6e-47c6-9d05-3f2a86bf0106 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:05.328426 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-456e26aa-a920-4dd2-be8f-871b4edf4291 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:05.329072 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-456e26aa-a920-4dd2-be8f-871b4edf4291 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:05.336290 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-456e26aa-a920-4dd2-be8f-871b4edf4291 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:05.337348 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-456e26aa-a920-4dd2-be8f-871b4edf4291 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:05.337348 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-456e26aa-a920-4dd2-be8f-871b4edf4291 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:05.337886 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-456e26aa-a920-4dd2-be8f-871b4edf4291 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:05.338347 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-456e26aa-a920-4dd2-be8f-871b4edf4291 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:05.338773 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-456e26aa-a920-4dd2-be8f-871b4edf4291 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:05.501831 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-f06f4e94-ca6e-47c6-9d05-3f2a86bf0106 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:05.512305 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-f06f4e94-ca6e-47c6-9d05-3f2a86bf0106 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:05.513767 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-456e26aa-a920-4dd2-be8f-871b4edf4291 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:05.514325 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-f06f4e94-ca6e-47c6-9d05-3f2a86bf0106 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:05.518387 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-f06f4e94-ca6e-47c6-9d05-3f2a86bf0106 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1746 microversion: 2.20 time: 0.224629 Aug 10 13:40:05.519521 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 146/316] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:05 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1746 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:40:05.524593 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-456e26aa-a920-4dd2-be8f-871b4edf4291 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1720 microversion: 2.1 time: 0.200408 Aug 10 13:40:05.530825 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 171/317] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:05 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1720 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:05.569285 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-6d30fd98-d60a-436e-bb92-63fa128944c3 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:05.570023 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-6d30fd98-d60a-436e-bb92-63fa128944c3 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:05.578351 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6d30fd98-d60a-436e-bb92-63fa128944c3 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:05.581142 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6d30fd98-d60a-436e-bb92-63fa128944c3 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:05.582267 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6d30fd98-d60a-436e-bb92-63fa128944c3 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:05.583127 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6d30fd98-d60a-436e-bb92-63fa128944c3 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:05.583661 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6d30fd98-d60a-436e-bb92-63fa128944c3 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:05.584836 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6d30fd98-d60a-436e-bb92-63fa128944c3 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:05.748740 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-6d30fd98-d60a-436e-bb92-63fa128944c3 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:05.757203 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-6d30fd98-d60a-436e-bb92-63fa128944c3 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1371 microversion: 2.1 time: 0.193151 Aug 10 13:40:05.771086 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 147/318] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:05 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1371 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:05.980124 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-98d273d2-43af-4249-a562-84232b3e0241 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:05.980797 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-98d273d2-43af-4249-a562-84232b3e0241 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 0d6055de-aea1-4e3b-9016-4c25dca9f779] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:06.000283 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-98d273d2-43af-4249-a562-84232b3e0241 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:06.000776 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-98d273d2-43af-4249-a562-84232b3e0241 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:06.001212 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-98d273d2-43af-4249-a562-84232b3e0241 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:06.001954 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-98d273d2-43af-4249-a562-84232b3e0241 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:06.002409 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-98d273d2-43af-4249-a562-84232b3e0241 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:06.002835 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-98d273d2-43af-4249-a562-84232b3e0241 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:06.146767 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-98d273d2-43af-4249-a562-84232b3e0241 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:06.155990 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-98d273d2-43af-4249-a562-84232b3e0241 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779" status: 200 len: 1365 microversion: 2.1 time: 0.179662 Aug 10 13:40:06.157179 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 172/319] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:05 2022] GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779 => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:06.275702 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-27bfdae6-ca73-49c7-b263-c9c2cf77dfe5 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:06.276985 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-27bfdae6-ca73-49c7-b263-c9c2cf77dfe5 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] [instance: 35e80236-b69c-4206-b6a0-1565f57de305] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:06.294935 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-27bfdae6-ca73-49c7-b263-c9c2cf77dfe5 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:06.295435 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-27bfdae6-ca73-49c7-b263-c9c2cf77dfe5 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:06.295876 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-27bfdae6-ca73-49c7-b263-c9c2cf77dfe5 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:06.301305 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-27bfdae6-ca73-49c7-b263-c9c2cf77dfe5 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:06.302311 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-27bfdae6-ca73-49c7-b263-c9c2cf77dfe5 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:06.302774 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-27bfdae6-ca73-49c7-b263-c9c2cf77dfe5 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:06.543725 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-ab1f6756-6e3c-4c3f-a88b-2b081f90c28c tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:06.544351 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-ab1f6756-6e3c-4c3f-a88b-2b081f90c28c tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:06.548374 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:40:06.562800 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ab1f6756-6e3c-4c3f-a88b-2b081f90c28c tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:06.563311 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ab1f6756-6e3c-4c3f-a88b-2b081f90c28c tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:06.563757 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ab1f6756-6e3c-4c3f-a88b-2b081f90c28c tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:06.564489 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ab1f6756-6e3c-4c3f-a88b-2b081f90c28c tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:06.569821 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ab1f6756-6e3c-4c3f-a88b-2b081f90c28c tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:06.570362 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ab1f6756-6e3c-4c3f-a88b-2b081f90c28c tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:06.843288 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-ab1f6756-6e3c-4c3f-a88b-2b081f90c28c tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:06.854741 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-ab1f6756-6e3c-4c3f-a88b-2b081f90c28c tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:06.856526 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-ab1f6756-6e3c-4c3f-a88b-2b081f90c28c tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:06.864885 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-ab1f6756-6e3c-4c3f-a88b-2b081f90c28c tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1746 microversion: 2.20 time: 0.325130 Aug 10 13:40:06.866160 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 173/320] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:06 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1746 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:40:06.871081 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-995b4145-a158-431c-8dcc-1fd0680ccdd9 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:06.872979 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-995b4145-a158-431c-8dcc-1fd0680ccdd9 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:06.882938 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-995b4145-a158-431c-8dcc-1fd0680ccdd9 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:06.884855 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-995b4145-a158-431c-8dcc-1fd0680ccdd9 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:06.885621 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-995b4145-a158-431c-8dcc-1fd0680ccdd9 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:06.886707 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-995b4145-a158-431c-8dcc-1fd0680ccdd9 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:06.889167 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-995b4145-a158-431c-8dcc-1fd0680ccdd9 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:06.893577 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-995b4145-a158-431c-8dcc-1fd0680ccdd9 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:06.936408 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-27bfdae6-ca73-49c7-b263-c9c2cf77dfe5 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da32c0efe44b9f8f8ada1c11fa8fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da601c9db023410d9a12c6d7bf1eb0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:06.949157 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-27bfdae6-ca73-49c7-b263-c9c2cf77dfe5 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] 10.222.0.52 "GET /compute/v2.1/servers/35e80236-b69c-4206-b6a0-1565f57de305" status: 200 len: 1469 microversion: 2.1 time: 0.678196 Aug 10 13:40:06.963673 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 148/321] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:06 2022] GET /compute/v2.1/servers/35e80236-b69c-4206-b6a0-1565f57de305 => generated 1469 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:06.972274 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-911277b1-786b-4bac-8132-6b24c3942968 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:06.973756 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-911277b1-786b-4bac-8132-6b24c3942968 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:06.980487 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-911277b1-786b-4bac-8132-6b24c3942968 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:06.981250 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-911277b1-786b-4bac-8132-6b24c3942968 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:06.982016 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-911277b1-786b-4bac-8132-6b24c3942968 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:06.983079 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-911277b1-786b-4bac-8132-6b24c3942968 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:06.984355 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-911277b1-786b-4bac-8132-6b24c3942968 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:06.984940 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-911277b1-786b-4bac-8132-6b24c3942968 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:07.383738 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-995b4145-a158-431c-8dcc-1fd0680ccdd9 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:07.394117 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-995b4145-a158-431c-8dcc-1fd0680ccdd9 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1720 microversion: 2.1 time: 0.526514 Aug 10 13:40:07.395217 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 174/322] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:06 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1720 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:07.422101 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-2eb9c721-69e5-4960-be7e-12981337a1e6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:07.422739 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-2eb9c721-69e5-4960-be7e-12981337a1e6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 0d6055de-aea1-4e3b-9016-4c25dca9f779] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:07.439113 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2eb9c721-69e5-4960-be7e-12981337a1e6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:07.439622 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2eb9c721-69e5-4960-be7e-12981337a1e6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:07.440045 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2eb9c721-69e5-4960-be7e-12981337a1e6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:07.440752 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2eb9c721-69e5-4960-be7e-12981337a1e6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:07.441202 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2eb9c721-69e5-4960-be7e-12981337a1e6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:07.441685 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2eb9c721-69e5-4960-be7e-12981337a1e6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:07.607726 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-911277b1-786b-4bac-8132-6b24c3942968 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:07.616307 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-911277b1-786b-4bac-8132-6b24c3942968 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1371 microversion: 2.1 time: 0.651177 Aug 10 13:40:07.621757 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 149/323] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:06 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1371 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:07.626423 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-487ac244-2355-4bb9-a88a-6ebb760ab881 req-1b621ff0-0904-45b6-8c7a-daee7a1048a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35e80236-b69c-4206-b6a0-1565f57de305", "name": "network-vif-deleted", "tag": "5ab23a4e-ee41-4255-8aa3-10a6ffcfec91"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:40:07.654555 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-487ac244-2355-4bb9-a88a-6ebb760ab881 req-1b621ff0-0904-45b6-8c7a-daee7a1048a9 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:07.657272 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-487ac244-2355-4bb9-a88a-6ebb760ab881 req-1b621ff0-0904-45b6-8c7a-daee7a1048a9 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:07.657902 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-487ac244-2355-4bb9-a88a-6ebb760ab881 req-1b621ff0-0904-45b6-8c7a-daee7a1048a9 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:07.679650 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-487ac244-2355-4bb9-a88a-6ebb760ab881 req-1b621ff0-0904-45b6-8c7a-daee7a1048a9 service nova] Creating event network-vif-deleted:5ab23a4e-ee41-4255-8aa3-10a6ffcfec91 for instance 35e80236-b69c-4206-b6a0-1565f57de305 on hv-cinder-85200 Aug 10 13:40:07.690860 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-487ac244-2355-4bb9-a88a-6ebb760ab881 req-1b621ff0-0904-45b6-8c7a-daee7a1048a9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067791 Aug 10 13:40:07.693246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 150/324] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:40:07.701612 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-2eb9c721-69e5-4960-be7e-12981337a1e6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:07.710466 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-2eb9c721-69e5-4960-be7e-12981337a1e6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779" status: 200 len: 1365 microversion: 2.1 time: 0.314171 Aug 10 13:40:07.724287 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 175/325] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:07 2022] GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779 => generated 1365 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:07.737025 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-5a62e628-c88c-4491-85ca-d1dbc9a254a0 req-481a8f35-42ef-4cc5-8b2e-95d0f60c59dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d6055de-aea1-4e3b-9016-4c25dca9f779", "name": "network-vif-plugged", "status": "completed", "tag": "609518cd-9119-4805-aafe-d15f58ca5d2b"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:40:07.752321 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-5a62e628-c88c-4491-85ca-d1dbc9a254a0 req-481a8f35-42ef-4cc5-8b2e-95d0f60c59dd service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:07.752840 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-5a62e628-c88c-4491-85ca-d1dbc9a254a0 req-481a8f35-42ef-4cc5-8b2e-95d0f60c59dd service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:07.753389 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-5a62e628-c88c-4491-85ca-d1dbc9a254a0 req-481a8f35-42ef-4cc5-8b2e-95d0f60c59dd service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:07.807795 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-5a62e628-c88c-4491-85ca-d1dbc9a254a0 req-481a8f35-42ef-4cc5-8b2e-95d0f60c59dd service nova] Creating event network-vif-plugged:609518cd-9119-4805-aafe-d15f58ca5d2b for instance 0d6055de-aea1-4e3b-9016-4c25dca9f779 on hv-cinder-85200 Aug 10 13:40:07.829357 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-5a62e628-c88c-4491-85ca-d1dbc9a254a0 req-481a8f35-42ef-4cc5-8b2e-95d0f60c59dd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094251 Aug 10 13:40:07.830940 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 151/326] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:40:07.890129 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-3db62f56-9b7e-450c-b88d-65ffd728cc3d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:07.891850 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-3db62f56-9b7e-450c-b88d-65ffd728cc3d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:07.908916 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3db62f56-9b7e-450c-b88d-65ffd728cc3d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:07.909330 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3db62f56-9b7e-450c-b88d-65ffd728cc3d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:07.909956 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3db62f56-9b7e-450c-b88d-65ffd728cc3d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:07.910903 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3db62f56-9b7e-450c-b88d-65ffd728cc3d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:07.911539 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3db62f56-9b7e-450c-b88d-65ffd728cc3d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:07.912131 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3db62f56-9b7e-450c-b88d-65ffd728cc3d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:07.977218 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-49adb188-928f-4f7b-8ace-2004d31489ef tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:07.981865 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-49adb188-928f-4f7b-8ace-2004d31489ef tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] [instance: 35e80236-b69c-4206-b6a0-1565f57de305] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:07.991263 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-49adb188-928f-4f7b-8ace-2004d31489ef tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:07.992502 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-49adb188-928f-4f7b-8ace-2004d31489ef tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:07.993377 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-49adb188-928f-4f7b-8ace-2004d31489ef tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:07.995384 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-49adb188-928f-4f7b-8ace-2004d31489ef tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:07.996063 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-49adb188-928f-4f7b-8ace-2004d31489ef tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:07.996698 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-49adb188-928f-4f7b-8ace-2004d31489ef tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:08.074278 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-49adb188-928f-4f7b-8ace-2004d31489ef tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:08.075702 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-49adb188-928f-4f7b-8ace-2004d31489ef tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:08.076424 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-49adb188-928f-4f7b-8ace-2004d31489ef tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:08.078616 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.objects.instance [None req-49adb188-928f-4f7b-8ace-2004d31489ef tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lazy-loading 'fault' on Instance uuid 35e80236-b69c-4206-b6a0-1565f57de305 {{(pid=129523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:40:08.172059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-49adb188-928f-4f7b-8ace-2004d31489ef tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31da32c0efe44b9f8f8ada1c11fa8fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da601c9db023410d9a12c6d7bf1eb0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:08.182088 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-49adb188-928f-4f7b-8ace-2004d31489ef tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] 10.222.0.52 "GET /compute/v2.1/servers/35e80236-b69c-4206-b6a0-1565f57de305" status: 200 len: 1303 microversion: 2.1 time: 0.210654 Aug 10 13:40:08.183040 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 152/327] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:07 2022] GET /compute/v2.1/servers/35e80236-b69c-4206-b6a0-1565f57de305 => generated 1303 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:40:08.199013 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-3db62f56-9b7e-450c-b88d-65ffd728cc3d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:08.211484 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-3db62f56-9b7e-450c-b88d-65ffd728cc3d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:08.213008 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-3db62f56-9b7e-450c-b88d-65ffd728cc3d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:08.214249 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-3db62f56-9b7e-450c-b88d-65ffd728cc3d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1746 microversion: 2.20 time: 0.328208 Aug 10 13:40:08.225915 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 176/328] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:07 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1746 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:40:08.416428 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-4a1a6494-a20c-40e2-b10e-b5ae8b82ffcc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:08.417039 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-4a1a6494-a20c-40e2-b10e-b5ae8b82ffcc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:08.426848 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4a1a6494-a20c-40e2-b10e-b5ae8b82ffcc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:08.427266 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4a1a6494-a20c-40e2-b10e-b5ae8b82ffcc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:08.427708 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4a1a6494-a20c-40e2-b10e-b5ae8b82ffcc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:08.428411 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4a1a6494-a20c-40e2-b10e-b5ae8b82ffcc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:08.428870 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4a1a6494-a20c-40e2-b10e-b5ae8b82ffcc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:08.429324 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4a1a6494-a20c-40e2-b10e-b5ae8b82ffcc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:08.450891 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:40:08.584585 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-4a1a6494-a20c-40e2-b10e-b5ae8b82ffcc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:08.593304 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-4a1a6494-a20c-40e2-b10e-b5ae8b82ffcc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1720 microversion: 2.1 time: 0.180651 Aug 10 13:40:08.594104 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 153/329] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:08 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1720 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:08.651841 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-1896e634-21ad-4eb9-bcac-a229afe5c64c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:08.653080 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-1896e634-21ad-4eb9-bcac-a229afe5c64c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:08.659971 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1896e634-21ad-4eb9-bcac-a229afe5c64c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:08.660672 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1896e634-21ad-4eb9-bcac-a229afe5c64c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:08.661295 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1896e634-21ad-4eb9-bcac-a229afe5c64c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:08.662233 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1896e634-21ad-4eb9-bcac-a229afe5c64c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:08.662850 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1896e634-21ad-4eb9-bcac-a229afe5c64c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:08.663433 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1896e634-21ad-4eb9-bcac-a229afe5c64c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:08.680600 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell1:SELECT=100 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:40:08.735428 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-dbfb7f8f-6634-47e4-90a6-09775c4b402f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:08.736005 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-dbfb7f8f-6634-47e4-90a6-09775c4b402f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 0d6055de-aea1-4e3b-9016-4c25dca9f779] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:08.743144 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-dbfb7f8f-6634-47e4-90a6-09775c4b402f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:08.744266 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-dbfb7f8f-6634-47e4-90a6-09775c4b402f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:08.744912 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-dbfb7f8f-6634-47e4-90a6-09775c4b402f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:08.745796 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-dbfb7f8f-6634-47e4-90a6-09775c4b402f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:08.747150 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-dbfb7f8f-6634-47e4-90a6-09775c4b402f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:08.747962 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-dbfb7f8f-6634-47e4-90a6-09775c4b402f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:08.826336 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-1896e634-21ad-4eb9-bcac-a229afe5c64c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:08.836436 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-1896e634-21ad-4eb9-bcac-a229afe5c64c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1371 microversion: 2.1 time: 0.188399 Aug 10 13:40:08.838498 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 177/330] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:08 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1371 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:08.915391 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-dbfb7f8f-6634-47e4-90a6-09775c4b402f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:08.922908 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-dbfb7f8f-6634-47e4-90a6-09775c4b402f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779" status: 200 len: 1365 microversion: 2.1 time: 0.191430 Aug 10 13:40:08.923476 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 154/331] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:08 2022] GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779 => generated 1365 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:40:09.209711 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-cc045d33-ded9-42c4-8424-512568aa34e9 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:09.210831 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-cc045d33-ded9-42c4-8424-512568aa34e9 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] [instance: 35e80236-b69c-4206-b6a0-1565f57de305] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:09.219562 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cc045d33-ded9-42c4-8424-512568aa34e9 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:09.220480 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cc045d33-ded9-42c4-8424-512568aa34e9 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:09.221187 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cc045d33-ded9-42c4-8424-512568aa34e9 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:09.222680 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cc045d33-ded9-42c4-8424-512568aa34e9 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:09.223836 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cc045d33-ded9-42c4-8424-512568aa34e9 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:09.224418 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cc045d33-ded9-42c4-8424-512568aa34e9 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:09.244855 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-7acb70ef-33e0-4a7c-bebf-5e1b7a4aba73 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:09.245975 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-7acb70ef-33e0-4a7c-bebf-5e1b7a4aba73 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:09.246829 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.wsgi [None req-cc045d33-ded9-42c4-8424-512568aa34e9 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] HTTP exception thrown: Instance 35e80236-b69c-4206-b6a0-1565f57de305 could not be found. Aug 10 13:40:09.249913 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-cc045d33-ded9-42c4-8424-512568aa34e9 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Request method failure captured: Aug 10 13:40:09.249913 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: request: GET /compute/v2.1/servers/35e80236-b69c-4206-b6a0-1565f57de305 HTTP/1.1 Aug 10 13:40:09.249913 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept: application/json Aug 10 13:40:09.249913 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept-Encoding: identity Aug 10 13:40:09.249913 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Connection: close Aug 10 13:40:09.249913 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Length: 0 Aug 10 13:40:09.249913 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Type: application/json Aug 10 13:40:09.249913 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Host: 10.222.0.52 Aug 10 13:40:09.249913 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Openstack-System-Scope: None Aug 10 13:40:09.249913 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: User-Agent: python-urllib3/1.26.11 Aug 10 13:40:09.249913 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Auth-Token: gAAAAABi87UhTbEscozt1E7MLndHq3STQZa7fU124_i85U_54PuYhLTYws5YOOafp6pfxNeh44grwyiN6gm7ieGzLBg2oNDq_Y9mXlV7J6KkBZFC0C77iusY4u1sD0DYi6ePAysFRnFIavcuzRBvoWZ23GSuktCrmVyoO1jFJB47p_iFaHbGyTg Aug 10 13:40:09.249913 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Id: None Aug 10 13:40:09.249913 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Name: None Aug 10 13:40:09.249913 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Identity-Status: Confirmed Aug 10 13:40:09.249913 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Is-Admin-Project: True Aug 10 13:40:09.249913 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Id: default Aug 10 13:40:09.249913 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Name: Default Aug 10 13:40:09.249913 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Id: da601c9db023410d9a12c6d7bf1eb0e0 Aug 10 13:40:09.249913 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Name: tempest-VolumesNegativeTest-784176488 Aug 10 13:40:09.249913 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Role: member,reader Aug 10 13:40:09.249913 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Roles: member,reader Aug 10 13:40:09.251282 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/da601c9db023410d9a12c6d7bf1eb0e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/da601c9db023410d9a12c6d7bf1eb0e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_da601c9db023410d9a12c6d7bf1eb0e0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/da601c9db023410d9a12c6d7bf1eb0e0"}]}] Aug 10 13:40:09.251282 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant: tempest-VolumesNegativeTest-784176488 Aug 10 13:40:09.251282 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Id: da601c9db023410d9a12c6d7bf1eb0e0 Aug 10 13:40:09.251282 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Name: tempest-VolumesNegativeTest-784176488 Aug 10 13:40:09.251282 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User: tempest-VolumesNegativeTest-784176488-project Aug 10 13:40:09.251282 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Id: default Aug 10 13:40:09.251282 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Name: Default Aug 10 13:40:09.251282 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Id: 31da32c0efe44b9f8f8ada1c11fa8fb4 Aug 10 13:40:09.251282 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Name: tempest-VolumesNegativeTest-784176488-project Aug 10 13:40:09.251282 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: method: > Aug 10 13:40:09.251282 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: exception: Instance 35e80236-b69c-4206-b6a0-1565f57de305 could not be found. Aug 10 13:40:09.251282 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: action_args: {'id': '35e80236-b69c-4206-b6a0-1565f57de305'} Aug 10 13:40:09.252055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:40:09.252055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:40:09.252055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:40:09.252055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:40:09.252055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:40:09.252055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:40:09.252055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:40:09.252055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:40:09.252055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:40:09.252055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:40:09.252055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35e80236-b69c-4206-b6a0-1565f57de305 could not be found. Aug 10 13:40:09.252055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:40:09.252055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:40:09.252055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:40:09.252055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:40:09.252055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:40:09.252055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:40:09.252055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:40:09.252055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:40:09.252055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:40:09.253896 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:40:09.253896 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:40:09.253896 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:40:09.253896 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:40:09.253896 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:40:09.253896 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:40:09.253896 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:40:09.253896 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35e80236-b69c-4206-b6a0-1565f57de305 could not be found. Aug 10 13:40:09.253896 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:40:09.253896 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:40:09.253896 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:40:09.253896 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:40:09.253896 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:40:09.253896 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:40:09.253896 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:40:09.253896 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:40:09.253896 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35e80236-b69c-4206-b6a0-1565f57de305 could not be found. Aug 10 13:40:09.253896 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:40:09.257456 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-cc045d33-ded9-42c4-8424-512568aa34e9 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] Returning 404 to user: Instance 35e80236-b69c-4206-b6a0-1565f57de305 could not be found. {{(pid=129522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:40:09.257456 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-cc045d33-ded9-42c4-8424-512568aa34e9 tempest-VolumesNegativeTest-784176488 tempest-VolumesNegativeTest-784176488-project] 10.222.0.52 "GET /compute/v2.1/servers/35e80236-b69c-4206-b6a0-1565f57de305" status: 404 len: 111 microversion: 2.1 time: 0.046563 Aug 10 13:40:09.264125 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7acb70ef-33e0-4a7c-bebf-5e1b7a4aba73 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:09.264785 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7acb70ef-33e0-4a7c-bebf-5e1b7a4aba73 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:09.265344 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7acb70ef-33e0-4a7c-bebf-5e1b7a4aba73 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:09.266744 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7acb70ef-33e0-4a7c-bebf-5e1b7a4aba73 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:09.267418 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7acb70ef-33e0-4a7c-bebf-5e1b7a4aba73 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:09.269369 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7acb70ef-33e0-4a7c-bebf-5e1b7a4aba73 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:09.269982 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 178/332] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:09 2022] GET /compute/v2.1/servers/35e80236-b69c-4206-b6a0-1565f57de305 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:40:09.587173 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-7acb70ef-33e0-4a7c-bebf-5e1b7a4aba73 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:09.600432 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-7acb70ef-33e0-4a7c-bebf-5e1b7a4aba73 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:09.603135 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-7acb70ef-33e0-4a7c-bebf-5e1b7a4aba73 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:09.610843 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-7acb70ef-33e0-4a7c-bebf-5e1b7a4aba73 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1746 microversion: 2.20 time: 0.374807 Aug 10 13:40:09.615503 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-70ee56db-c25c-4b0d-b817-88d05a48f125 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:09.616376 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-70ee56db-c25c-4b0d-b817-88d05a48f125 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:09.623358 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-70ee56db-c25c-4b0d-b817-88d05a48f125 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:09.623915 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-70ee56db-c25c-4b0d-b817-88d05a48f125 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:09.624412 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-70ee56db-c25c-4b0d-b817-88d05a48f125 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:09.625172 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-70ee56db-c25c-4b0d-b817-88d05a48f125 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:09.625715 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-70ee56db-c25c-4b0d-b817-88d05a48f125 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:09.626195 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-70ee56db-c25c-4b0d-b817-88d05a48f125 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:09.628801 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 155/333] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:09 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1746 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:40:09.819011 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-70ee56db-c25c-4b0d-b817-88d05a48f125 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:09.827795 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-70ee56db-c25c-4b0d-b817-88d05a48f125 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1720 microversion: 2.1 time: 0.217075 Aug 10 13:40:09.829028 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 179/334] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:09 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1720 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:40:09.855629 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-7f5b0cf9-83c8-4783-8ebe-d01bafff9ff5 req-1c957719-4a16-4658-ad83-5980fb4eded3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdba9a34-3f3e-4314-a377-e6dc259c27cb", "name": "network-vif-plugged", "status": "completed", "tag": "3fd93ef8-553f-4b67-8470-c80fc47f7c94"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:40:09.859357 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-de541e1a-9294-4360-832f-f73513a51416 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:09.860346 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-de541e1a-9294-4360-832f-f73513a51416 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:09.868157 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-7f5b0cf9-83c8-4783-8ebe-d01bafff9ff5 req-1c957719-4a16-4658-ad83-5980fb4eded3 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:09.869019 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-de541e1a-9294-4360-832f-f73513a51416 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:09.869477 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-7f5b0cf9-83c8-4783-8ebe-d01bafff9ff5 req-1c957719-4a16-4658-ad83-5980fb4eded3 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:09.869620 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-de541e1a-9294-4360-832f-f73513a51416 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:09.869959 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-de541e1a-9294-4360-832f-f73513a51416 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:09.870419 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-7f5b0cf9-83c8-4783-8ebe-d01bafff9ff5 req-1c957719-4a16-4658-ad83-5980fb4eded3 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:09.873265 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-de541e1a-9294-4360-832f-f73513a51416 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:09.873957 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-de541e1a-9294-4360-832f-f73513a51416 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:09.874549 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-de541e1a-9294-4360-832f-f73513a51416 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:09.890894 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-7f5b0cf9-83c8-4783-8ebe-d01bafff9ff5 req-1c957719-4a16-4658-ad83-5980fb4eded3 service nova] Creating event network-vif-plugged:3fd93ef8-553f-4b67-8470-c80fc47f7c94 for instance cdba9a34-3f3e-4314-a377-e6dc259c27cb on hv-cinder-85200 Aug 10 13:40:09.897315 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-7f5b0cf9-83c8-4783-8ebe-d01bafff9ff5 req-1c957719-4a16-4658-ad83-5980fb4eded3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050397 Aug 10 13:40:09.899079 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 156/335] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:40:09.945827 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-ccb0c8f3-db20-4d2b-82a5-ce7dd4c27f13 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:09.946931 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-ccb0c8f3-db20-4d2b-82a5-ce7dd4c27f13 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 0d6055de-aea1-4e3b-9016-4c25dca9f779] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:09.959416 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ccb0c8f3-db20-4d2b-82a5-ce7dd4c27f13 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:09.961828 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ccb0c8f3-db20-4d2b-82a5-ce7dd4c27f13 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:09.962274 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ccb0c8f3-db20-4d2b-82a5-ce7dd4c27f13 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:09.965430 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ccb0c8f3-db20-4d2b-82a5-ce7dd4c27f13 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:09.965940 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ccb0c8f3-db20-4d2b-82a5-ce7dd4c27f13 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:09.966475 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ccb0c8f3-db20-4d2b-82a5-ce7dd4c27f13 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:10.149991 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-de541e1a-9294-4360-832f-f73513a51416 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:10.160637 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-de541e1a-9294-4360-832f-f73513a51416 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1371 microversion: 2.1 time: 0.305408 Aug 10 13:40:10.161525 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 180/336] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:09 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1371 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:10.174795 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-ccb0c8f3-db20-4d2b-82a5-ce7dd4c27f13 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:10.182997 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-ccb0c8f3-db20-4d2b-82a5-ce7dd4c27f13 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779" status: 200 len: 1555 microversion: 2.1 time: 0.243182 Aug 10 13:40:10.183781 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 157/337] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:09 2022] GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779 => generated 1555 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:40:10.208246 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-fff9ecb4-8941-499f-bb58-3da47427fe25 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:10.208996 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-fff9ecb4-8941-499f-bb58-3da47427fe25 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 0d6055de-aea1-4e3b-9016-4c25dca9f779] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:10.215894 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fff9ecb4-8941-499f-bb58-3da47427fe25 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:10.216582 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fff9ecb4-8941-499f-bb58-3da47427fe25 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:10.217164 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fff9ecb4-8941-499f-bb58-3da47427fe25 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:10.218127 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fff9ecb4-8941-499f-bb58-3da47427fe25 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:10.218720 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fff9ecb4-8941-499f-bb58-3da47427fe25 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:10.219299 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fff9ecb4-8941-499f-bb58-3da47427fe25 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:10.366948 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-fff9ecb4-8941-499f-bb58-3da47427fe25 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.162319 Aug 10 13:40:10.367814 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 181/338] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Aug 10 13:40:10 2022] GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779/os-interface => generated 284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:40:10.637394 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-8fdf4912-c9e1-47d0-932c-62f684bc80c8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:10.638013 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-8fdf4912-c9e1-47d0-932c-62f684bc80c8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:10.653598 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8fdf4912-c9e1-47d0-932c-62f684bc80c8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:10.653598 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8fdf4912-c9e1-47d0-932c-62f684bc80c8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:10.653598 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8fdf4912-c9e1-47d0-932c-62f684bc80c8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:10.653598 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8fdf4912-c9e1-47d0-932c-62f684bc80c8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:10.662625 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8fdf4912-c9e1-47d0-932c-62f684bc80c8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:10.663187 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8fdf4912-c9e1-47d0-932c-62f684bc80c8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:10.857367 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-4edaec0c-7023-49a9-8312-04af97459ae8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:10.860917 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-4edaec0c-7023-49a9-8312-04af97459ae8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:10.869434 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4edaec0c-7023-49a9-8312-04af97459ae8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:10.869981 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4edaec0c-7023-49a9-8312-04af97459ae8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:10.870867 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4edaec0c-7023-49a9-8312-04af97459ae8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:10.871670 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4edaec0c-7023-49a9-8312-04af97459ae8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:10.872207 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4edaec0c-7023-49a9-8312-04af97459ae8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:10.872643 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4edaec0c-7023-49a9-8312-04af97459ae8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:10.944444 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-8fdf4912-c9e1-47d0-932c-62f684bc80c8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:10.970897 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-8fdf4912-c9e1-47d0-932c-62f684bc80c8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:10.972434 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-8fdf4912-c9e1-47d0-932c-62f684bc80c8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:10.973678 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-8fdf4912-c9e1-47d0-932c-62f684bc80c8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1741 microversion: 2.20 time: 0.341474 Aug 10 13:40:10.974296 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 158/339] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:10 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1741 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:40:11.181917 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-8967c613-91af-4e5c-bed7-36087d0bfc50 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:11.182547 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-8967c613-91af-4e5c-bed7-36087d0bfc50 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:11.195150 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8967c613-91af-4e5c-bed7-36087d0bfc50 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:11.195935 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8967c613-91af-4e5c-bed7-36087d0bfc50 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:11.196555 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8967c613-91af-4e5c-bed7-36087d0bfc50 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:11.197537 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8967c613-91af-4e5c-bed7-36087d0bfc50 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:11.198148 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8967c613-91af-4e5c-bed7-36087d0bfc50 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:11.198730 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8967c613-91af-4e5c-bed7-36087d0bfc50 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:11.206813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-4edaec0c-7023-49a9-8312-04af97459ae8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:11.224086 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-4edaec0c-7023-49a9-8312-04af97459ae8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1720 microversion: 2.1 time: 0.379468 Aug 10 13:40:11.225927 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 182/340] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:10 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1720 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:40:11.437390 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-8967c613-91af-4e5c-bed7-36087d0bfc50 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:11.447449 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-8967c613-91af-4e5c-bed7-36087d0bfc50 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1371 microversion: 2.1 time: 0.269255 Aug 10 13:40:11.449355 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 159/341] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:11 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1371 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:11.913222 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-a1d4b943-f9bc-44c3-b03b-64338d12794c req-62258f1a-f0f4-4980-97b8-73712a9c2371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51cd434d-31c3-4588-aed7-48e7130c5131", "name": "network-vif-plugged", "status": "completed", "tag": "514f1eb9-5330-47e3-b4c5-db965c497335"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:40:11.932301 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-a1d4b943-f9bc-44c3-b03b-64338d12794c req-62258f1a-f0f4-4980-97b8-73712a9c2371 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:11.933067 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-a1d4b943-f9bc-44c3-b03b-64338d12794c req-62258f1a-f0f4-4980-97b8-73712a9c2371 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:11.933699 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-a1d4b943-f9bc-44c3-b03b-64338d12794c req-62258f1a-f0f4-4980-97b8-73712a9c2371 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:11.952603 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-a1d4b943-f9bc-44c3-b03b-64338d12794c req-62258f1a-f0f4-4980-97b8-73712a9c2371 service nova] Creating event network-vif-plugged:514f1eb9-5330-47e3-b4c5-db965c497335 for instance 51cd434d-31c3-4588-aed7-48e7130c5131 on hv-cinder-85200 Aug 10 13:40:11.964182 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-a1d4b943-f9bc-44c3-b03b-64338d12794c req-62258f1a-f0f4-4980-97b8-73712a9c2371 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053983 Aug 10 13:40:11.964182 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 183/342] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:40:11.981479 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-07965a1a-da29-4aef-978b-9a190adeb4f6 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Action: 'create', calling method: .version_select at 0x7f49c4736a60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2126795437", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWIANtEMttcqQaLxxQcd+3nVSAQmlv94Af2zET1gVrMXDPVO87VM2H1h+ETrBxUnCPq6zmAg7n6r35q1qSaPeLlk4M7VNPmesu3SJsAZpzwkpYMoOO0sloDYSGGXAqkOA=="}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:40:12.003740 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-349dfa53-d2fb-4ab6-a634-eec26ea2b08b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:12.004468 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-349dfa53-d2fb-4ab6-a634-eec26ea2b08b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:12.013188 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-349dfa53-d2fb-4ab6-a634-eec26ea2b08b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:12.025289 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-349dfa53-d2fb-4ab6-a634-eec26ea2b08b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:12.025961 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-349dfa53-d2fb-4ab6-a634-eec26ea2b08b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:12.026910 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-349dfa53-d2fb-4ab6-a634-eec26ea2b08b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:12.027571 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-349dfa53-d2fb-4ab6-a634-eec26ea2b08b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:12.029254 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-349dfa53-d2fb-4ab6-a634-eec26ea2b08b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:12.030168 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-07965a1a-da29-4aef-978b-9a190adeb4f6 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Getting quotas for project 2158cd74bdb44c47a905e34e97c5807f. Resources: {'key_pairs'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:40:12.041096 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-07965a1a-da29-4aef-978b-9a190adeb4f6 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Getting quotas for user ccc10397cf6a4b9084bcd6cdb12b8607 and project 2158cd74bdb44c47a905e34e97c5807f. Resources: {'key_pairs'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:40:12.104288 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-07965a1a-da29-4aef-978b-9a190adeb4f6 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.126745 Aug 10 13:40:12.111224 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 160/343] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Aug 10 13:40:11 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:40:12.255813 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-ad79b07a-faed-4aea-ad41-7b5b8829d73d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:12.256437 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-ad79b07a-faed-4aea-ad41-7b5b8829d73d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:12.278580 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ad79b07a-faed-4aea-ad41-7b5b8829d73d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:12.279459 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ad79b07a-faed-4aea-ad41-7b5b8829d73d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:12.280061 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ad79b07a-faed-4aea-ad41-7b5b8829d73d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:12.280940 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ad79b07a-faed-4aea-ad41-7b5b8829d73d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:12.281671 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ad79b07a-faed-4aea-ad41-7b5b8829d73d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:12.282258 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ad79b07a-faed-4aea-ad41-7b5b8829d73d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:12.488424 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-ad79b07a-faed-4aea-ad41-7b5b8829d73d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:12.500189 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-ad79b07a-faed-4aea-ad41-7b5b8829d73d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1720 microversion: 2.1 time: 0.248235 Aug 10 13:40:12.501865 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 161/344] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:12 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1720 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:40:12.507276 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-2466d13b-2904-4174-9064-cff6f37f4220 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-109266097", "imageRef": "fb399ca3-fed7-42ed-b24b-4f8b7176a823", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2126795437", "networks": [{"uuid": "7dccce22-23a9-4436-8fcb-a4fe09d964b5"}]}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:40:12.686747 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-349dfa53-d2fb-4ab6-a634-eec26ea2b08b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:12.700925 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-349dfa53-d2fb-4ab6-a634-eec26ea2b08b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:12.705661 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-349dfa53-d2fb-4ab6-a634-eec26ea2b08b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:12.707646 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-349dfa53-d2fb-4ab6-a634-eec26ea2b08b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1741 microversion: 2.20 time: 0.708067 Aug 10 13:40:12.722191 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 184/345] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:11 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1741 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:40:12.732984 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-4b34046a-b350-4879-bdd2-eda63686aa83 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:12.734055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-4b34046a-b350-4879-bdd2-eda63686aa83 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:12.742627 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4b34046a-b350-4879-bdd2-eda63686aa83 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:12.743453 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4b34046a-b350-4879-bdd2-eda63686aa83 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:12.744229 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4b34046a-b350-4879-bdd2-eda63686aa83 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:12.745105 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4b34046a-b350-4879-bdd2-eda63686aa83 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:12.746412 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4b34046a-b350-4879-bdd2-eda63686aa83 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:12.747021 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4b34046a-b350-4879-bdd2-eda63686aa83 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:12.957169 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-4b34046a-b350-4879-bdd2-eda63686aa83 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:12.966463 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-4b34046a-b350-4879-bdd2-eda63686aa83 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1371 microversion: 2.1 time: 0.242764 Aug 10 13:40:12.968149 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 185/346] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:12 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1371 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:12.978114 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-2518252e-8930-4000-97ab-c98fda42d13c req-a9fc9325-d3ed-4068-94ec-ddfac3179d8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d6055de-aea1-4e3b-9016-4c25dca9f779", "tag": "609518cd-9119-4805-aafe-d15f58ca5d2b"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:40:12.995157 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-2518252e-8930-4000-97ab-c98fda42d13c req-a9fc9325-d3ed-4068-94ec-ddfac3179d8b service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:12.995991 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-2518252e-8930-4000-97ab-c98fda42d13c req-a9fc9325-d3ed-4068-94ec-ddfac3179d8b service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:12.996718 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-2518252e-8930-4000-97ab-c98fda42d13c req-a9fc9325-d3ed-4068-94ec-ddfac3179d8b service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:13.010835 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-2518252e-8930-4000-97ab-c98fda42d13c req-a9fc9325-d3ed-4068-94ec-ddfac3179d8b service nova] Creating event network-changed:609518cd-9119-4805-aafe-d15f58ca5d2b for instance 0d6055de-aea1-4e3b-9016-4c25dca9f779 on hv-cinder-85200 Aug 10 13:40:13.019584 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-2518252e-8930-4000-97ab-c98fda42d13c req-a9fc9325-d3ed-4068-94ec-ddfac3179d8b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049880 Aug 10 13:40:13.025053 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 186/347] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:40:13.136091 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.network.neutron [None req-2466d13b-2904-4174-9064-cff6f37f4220 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] validate_networks() for [('7dccce22-23a9-4436-8fcb-a4fe09d964b5', None, None, None, None, None)] {{(pid=129523) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:40:13.526362 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-282f1462-79d4-4a17-92cb-f5628580c547 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:13.527153 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-282f1462-79d4-4a17-92cb-f5628580c547 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:13.544768 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-282f1462-79d4-4a17-92cb-f5628580c547 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:13.545398 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-282f1462-79d4-4a17-92cb-f5628580c547 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:13.545801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-282f1462-79d4-4a17-92cb-f5628580c547 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:13.546508 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-282f1462-79d4-4a17-92cb-f5628580c547 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:13.546971 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-282f1462-79d4-4a17-92cb-f5628580c547 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:13.547485 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-282f1462-79d4-4a17-92cb-f5628580c547 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:13.714237 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-282f1462-79d4-4a17-92cb-f5628580c547 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:13.726629 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-282f1462-79d4-4a17-92cb-f5628580c547 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1720 microversion: 2.1 time: 0.205184 Aug 10 13:40:13.727646 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 187/348] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:13 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1720 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:13.762706 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-17c69333-9681-4871-8fee-b736d0e4e93a tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:13.763844 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-17c69333-9681-4871-8fee-b736d0e4e93a tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:13.785998 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-17c69333-9681-4871-8fee-b736d0e4e93a tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:13.786552 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-17c69333-9681-4871-8fee-b736d0e4e93a tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:13.787071 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-17c69333-9681-4871-8fee-b736d0e4e93a tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:13.793907 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-17c69333-9681-4871-8fee-b736d0e4e93a tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:13.796573 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-17c69333-9681-4871-8fee-b736d0e4e93a tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:13.797253 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-17c69333-9681-4871-8fee-b736d0e4e93a tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:13.797741 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-2466d13b-2904-4174-9064-cff6f37f4220 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Flavor limits 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:40:13.798757 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-2466d13b-2904-4174-9064-cff6f37f4220 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Image limits 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:40:13.799496 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-2466d13b-2904-4174-9064-cff6f37f4220 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Flavor pref 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:40:13.802263 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-2466d13b-2904-4174-9064-cff6f37f4220 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Image pref 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:40:13.802972 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-2466d13b-2904-4174-9064-cff6f37f4220 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:40:13.815395 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2466d13b-2904-4174-9064-cff6f37f4220 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:13.816192 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2466d13b-2904-4174-9064-cff6f37f4220 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:13.817552 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2466d13b-2904-4174-9064-cff6f37f4220 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:13.818473 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2466d13b-2904-4174-9064-cff6f37f4220 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:13.819091 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2466d13b-2904-4174-9064-cff6f37f4220 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:13.819835 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2466d13b-2904-4174-9064-cff6f37f4220 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:13.851773 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-2466d13b-2904-4174-9064-cff6f37f4220 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Getting quotas for project 2158cd74bdb44c47a905e34e97c5807f. Resources: {'cores', 'ram', 'instances'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:40:13.857616 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-2466d13b-2904-4174-9064-cff6f37f4220 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Getting quotas for user ccc10397cf6a4b9084bcd6cdb12b8607 and project 2158cd74bdb44c47a905e34e97c5807f. Resources: {'cores', 'ram', 'instances'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:40:13.877151 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-2466d13b-2904-4174-9064-cff6f37f4220 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Going to run 1 instances... {{(pid=129523) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:40:13.880156 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-2466d13b-2904-4174-9064-cff6f37f4220 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fb399ca3-fed7-42ed-b24b-4f8b7176a823',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:40:13.899339 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:40:13.950230 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-2466d13b-2904-4174-9064-cff6f37f4220 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.446589 Aug 10 13:40:13.951098 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 162/349] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 10 13:40:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1448 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 13:40:13.967210 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-c3b714c4-debb-480d-a1cd-677baed0e84d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:13.968165 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-c3b714c4-debb-480d-a1cd-677baed0e84d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:14.084287 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-c3b714c4-debb-480d-a1cd-677baed0e84d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:14.092141 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-c3b714c4-debb-480d-a1cd-677baed0e84d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1258 microversion: 2.1 time: 0.132664 Aug 10 13:40:14.092716 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 163/350] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:13 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1258 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:14.111385 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-e0d123a7-2686-4f6f-8565-342120116d91 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:14.117139 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-e0d123a7-2686-4f6f-8565-342120116d91 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:14.123191 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e0d123a7-2686-4f6f-8565-342120116d91 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:14.123690 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e0d123a7-2686-4f6f-8565-342120116d91 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:14.124138 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e0d123a7-2686-4f6f-8565-342120116d91 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:14.124851 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e0d123a7-2686-4f6f-8565-342120116d91 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:14.125335 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e0d123a7-2686-4f6f-8565-342120116d91 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:14.125767 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e0d123a7-2686-4f6f-8565-342120116d91 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:14.335984 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-17c69333-9681-4871-8fee-b736d0e4e93a tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:14.345164 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-17c69333-9681-4871-8fee-b736d0e4e93a tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:14.349851 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-17c69333-9681-4871-8fee-b736d0e4e93a tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:14.359965 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-17c69333-9681-4871-8fee-b736d0e4e93a tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1741 microversion: 2.20 time: 0.623634 Aug 10 13:40:14.360876 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 188/351] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:13 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1741 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:40:14.382166 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-e0d123a7-2686-4f6f-8565-342120116d91 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:14.390799 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-e0d123a7-2686-4f6f-8565-342120116d91 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1371 microversion: 2.1 time: 0.292175 Aug 10 13:40:14.391376 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 164/352] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:14 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1371 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:14.756768 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-b6147e3b-39ca-4ec6-8dfb-1afb4f083f30 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:14.756768 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-b6147e3b-39ca-4ec6-8dfb-1afb4f083f30 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:14.763359 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b6147e3b-39ca-4ec6-8dfb-1afb4f083f30 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:14.765099 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b6147e3b-39ca-4ec6-8dfb-1afb4f083f30 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:14.765893 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b6147e3b-39ca-4ec6-8dfb-1afb4f083f30 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:14.767774 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b6147e3b-39ca-4ec6-8dfb-1afb4f083f30 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:14.768984 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b6147e3b-39ca-4ec6-8dfb-1afb4f083f30 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:14.772554 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b6147e3b-39ca-4ec6-8dfb-1afb4f083f30 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:15.120296 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-70256870-cc5a-41e1-ae4c-447201e15790 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:15.120920 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-70256870-cc5a-41e1-ae4c-447201e15790 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:15.143557 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-70256870-cc5a-41e1-ae4c-447201e15790 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:15.144261 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-70256870-cc5a-41e1-ae4c-447201e15790 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:15.146394 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-70256870-cc5a-41e1-ae4c-447201e15790 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:15.147293 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-70256870-cc5a-41e1-ae4c-447201e15790 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:15.147935 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-70256870-cc5a-41e1-ae4c-447201e15790 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:15.148524 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-70256870-cc5a-41e1-ae4c-447201e15790 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:15.300885 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-b6147e3b-39ca-4ec6-8dfb-1afb4f083f30 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:15.312594 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-70256870-cc5a-41e1-ae4c-447201e15790 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:15.326915 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-b6147e3b-39ca-4ec6-8dfb-1afb4f083f30 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1720 microversion: 2.1 time: 0.579865 Aug 10 13:40:15.331325 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-70256870-cc5a-41e1-ae4c-447201e15790 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1262 microversion: 2.1 time: 0.213406 Aug 10 13:40:15.334177 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 189/353] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:14 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1720 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:15.334810 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 165/354] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:15 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1262 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:40:15.396361 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-e5293072-60ba-49a1-beab-7ada6ac2b1e9 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:15.398783 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-e5293072-60ba-49a1-beab-7ada6ac2b1e9 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:15.413388 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-1defc5fc-46a2-4bd1-8114-eca283c92db4 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:15.415208 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-1defc5fc-46a2-4bd1-8114-eca283c92db4 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:15.449426 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e5293072-60ba-49a1-beab-7ada6ac2b1e9 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:15.450723 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e5293072-60ba-49a1-beab-7ada6ac2b1e9 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:15.454144 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1defc5fc-46a2-4bd1-8114-eca283c92db4 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:15.455496 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e5293072-60ba-49a1-beab-7ada6ac2b1e9 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:15.456329 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1defc5fc-46a2-4bd1-8114-eca283c92db4 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:15.457981 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1defc5fc-46a2-4bd1-8114-eca283c92db4 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:15.458774 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e5293072-60ba-49a1-beab-7ada6ac2b1e9 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:15.459717 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1defc5fc-46a2-4bd1-8114-eca283c92db4 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:15.460759 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e5293072-60ba-49a1-beab-7ada6ac2b1e9 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:15.463108 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e5293072-60ba-49a1-beab-7ada6ac2b1e9 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:15.466318 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1defc5fc-46a2-4bd1-8114-eca283c92db4 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:15.467432 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1defc5fc-46a2-4bd1-8114-eca283c92db4 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:15.687794 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-e5293072-60ba-49a1-beab-7ada6ac2b1e9 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:15.704476 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-e5293072-60ba-49a1-beab-7ada6ac2b1e9 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:15.711137 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-e5293072-60ba-49a1-beab-7ada6ac2b1e9 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:15.714227 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-e5293072-60ba-49a1-beab-7ada6ac2b1e9 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1741 microversion: 2.20 time: 0.325233 Aug 10 13:40:15.715600 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 166/355] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:15 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1741 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:40:15.722393 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-1defc5fc-46a2-4bd1-8114-eca283c92db4 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:15.731302 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-1defc5fc-46a2-4bd1-8114-eca283c92db4 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1565 microversion: 2.1 time: 0.323224 Aug 10 13:40:15.737871 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 190/356] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:15 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1565 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:40:15.753636 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-0f70b327-efe5-4b55-a0d5-1fde2dbf0a47 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:15.754754 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-0f70b327-efe5-4b55-a0d5-1fde2dbf0a47 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:15.765875 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0f70b327-efe5-4b55-a0d5-1fde2dbf0a47 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:15.766376 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0f70b327-efe5-4b55-a0d5-1fde2dbf0a47 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:15.766808 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0f70b327-efe5-4b55-a0d5-1fde2dbf0a47 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:15.767554 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0f70b327-efe5-4b55-a0d5-1fde2dbf0a47 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:15.768011 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0f70b327-efe5-4b55-a0d5-1fde2dbf0a47 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:15.768439 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0f70b327-efe5-4b55-a0d5-1fde2dbf0a47 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:15.869428 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-0f70b327-efe5-4b55-a0d5-1fde2dbf0a47 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.120082 Aug 10 13:40:15.870200 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 167/357] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Aug 10 13:40:15 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:40:16.357291 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-79f880e0-a6fb-4c20-aa45-c4b7b5befe59 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:16.361689 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-11d3cfc8-e84d-4c96-af1f-39f60348f0b6 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:16.362823 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-79f880e0-a6fb-4c20-aa45-c4b7b5befe59 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:16.364166 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-11d3cfc8-e84d-4c96-af1f-39f60348f0b6 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:16.383681 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-79f880e0-a6fb-4c20-aa45-c4b7b5befe59 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:16.384188 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-79f880e0-a6fb-4c20-aa45-c4b7b5befe59 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:16.384628 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-79f880e0-a6fb-4c20-aa45-c4b7b5befe59 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:16.385377 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-79f880e0-a6fb-4c20-aa45-c4b7b5befe59 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:16.387828 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-11d3cfc8-e84d-4c96-af1f-39f60348f0b6 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:16.389065 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-11d3cfc8-e84d-4c96-af1f-39f60348f0b6 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:16.389700 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-11d3cfc8-e84d-4c96-af1f-39f60348f0b6 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:16.391583 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-11d3cfc8-e84d-4c96-af1f-39f60348f0b6 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:16.392308 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-79f880e0-a6fb-4c20-aa45-c4b7b5befe59 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:16.392923 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-79f880e0-a6fb-4c20-aa45-c4b7b5befe59 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:16.393582 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-11d3cfc8-e84d-4c96-af1f-39f60348f0b6 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:16.395331 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-11d3cfc8-e84d-4c96-af1f-39f60348f0b6 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:16.622861 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-11d3cfc8-e84d-4c96-af1f-39f60348f0b6 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:16.651255 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-11d3cfc8-e84d-4c96-af1f-39f60348f0b6 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1316 microversion: 2.1 time: 0.298270 Aug 10 13:40:16.668110 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 191/358] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:16 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1316 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:16.741520 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-bf406f6a-ab4f-43af-a327-5a0114aeba16 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:16.742510 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-bf406f6a-ab4f-43af-a327-5a0114aeba16 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:16.757964 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-bf406f6a-ab4f-43af-a327-5a0114aeba16 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:16.758572 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-bf406f6a-ab4f-43af-a327-5a0114aeba16 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:16.759150 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-bf406f6a-ab4f-43af-a327-5a0114aeba16 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:16.761574 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-bf406f6a-ab4f-43af-a327-5a0114aeba16 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:16.764897 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-bf406f6a-ab4f-43af-a327-5a0114aeba16 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:16.766299 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-bf406f6a-ab4f-43af-a327-5a0114aeba16 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:17.061923 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-79f880e0-a6fb-4c20-aa45-c4b7b5befe59 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:17.077949 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-79f880e0-a6fb-4c20-aa45-c4b7b5befe59 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1720 microversion: 2.1 time: 0.724310 Aug 10 13:40:17.108209 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 168/359] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:16 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1720 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:17.376469 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-bf406f6a-ab4f-43af-a327-5a0114aeba16 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:17.397180 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-bf406f6a-ab4f-43af-a327-5a0114aeba16 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:17.408415 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-bf406f6a-ab4f-43af-a327-5a0114aeba16 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:17.410686 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-bf406f6a-ab4f-43af-a327-5a0114aeba16 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1741 microversion: 2.20 time: 0.674006 Aug 10 13:40:17.411491 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 192/360] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:16 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1741 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:40:17.677259 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-f4f39b18-1fda-4953-855c-f034b266d5ed tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:17.677890 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-f4f39b18-1fda-4953-855c-f034b266d5ed tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:17.694024 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f4f39b18-1fda-4953-855c-f034b266d5ed tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:17.694978 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f4f39b18-1fda-4953-855c-f034b266d5ed tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:17.696843 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f4f39b18-1fda-4953-855c-f034b266d5ed tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:17.701808 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f4f39b18-1fda-4953-855c-f034b266d5ed tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:17.702623 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f4f39b18-1fda-4953-855c-f034b266d5ed tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:17.703246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f4f39b18-1fda-4953-855c-f034b266d5ed tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:18.105297 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-e7eb7102-9e80-4534-9244-0fb1379e429d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:18.111282 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-e7eb7102-9e80-4534-9244-0fb1379e429d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:18.137575 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e7eb7102-9e80-4534-9244-0fb1379e429d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:18.145103 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e7eb7102-9e80-4534-9244-0fb1379e429d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:18.146322 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e7eb7102-9e80-4534-9244-0fb1379e429d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:18.150332 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e7eb7102-9e80-4534-9244-0fb1379e429d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:18.152278 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e7eb7102-9e80-4534-9244-0fb1379e429d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:18.153579 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e7eb7102-9e80-4534-9244-0fb1379e429d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:18.536623 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-f4f39b18-1fda-4953-855c-f034b266d5ed tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:18.548284 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-e7eb7102-9e80-4534-9244-0fb1379e429d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:18.563835 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-e7eb7102-9e80-4534-9244-0fb1379e429d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1720 microversion: 2.1 time: 0.464678 Aug 10 13:40:18.577768 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 193/361] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:18 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1720 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:18.586380 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-87681ff1-180f-47b4-a3f7-38aca026e0dc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:18.588314 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-87681ff1-180f-47b4-a3f7-38aca026e0dc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:18.603456 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-f4f39b18-1fda-4953-855c-f034b266d5ed tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1358 microversion: 2.1 time: 0.923777 Aug 10 13:40:18.613716 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 169/362] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:17 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1358 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:18.622861 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-87681ff1-180f-47b4-a3f7-38aca026e0dc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:18.623730 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-87681ff1-180f-47b4-a3f7-38aca026e0dc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:18.624399 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-87681ff1-180f-47b4-a3f7-38aca026e0dc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:18.625536 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-87681ff1-180f-47b4-a3f7-38aca026e0dc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:18.629072 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-87681ff1-180f-47b4-a3f7-38aca026e0dc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:18.629825 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-87681ff1-180f-47b4-a3f7-38aca026e0dc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:18.914207 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-e1a1f177-b373-440d-a158-76a7d533e2e2 req-d838f9bd-4a3a-48dd-b502-ba9513a30c39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51cd434d-31c3-4588-aed7-48e7130c5131", "tag": "514f1eb9-5330-47e3-b4c5-db965c497335"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:40:18.925095 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-e1a1f177-b373-440d-a158-76a7d533e2e2 req-d838f9bd-4a3a-48dd-b502-ba9513a30c39 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:18.931170 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-e1a1f177-b373-440d-a158-76a7d533e2e2 req-d838f9bd-4a3a-48dd-b502-ba9513a30c39 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:18.935427 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-e1a1f177-b373-440d-a158-76a7d533e2e2 req-d838f9bd-4a3a-48dd-b502-ba9513a30c39 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:18.959737 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-e1a1f177-b373-440d-a158-76a7d533e2e2 req-d838f9bd-4a3a-48dd-b502-ba9513a30c39 service nova] Creating event network-changed:514f1eb9-5330-47e3-b4c5-db965c497335 for instance 51cd434d-31c3-4588-aed7-48e7130c5131 on hv-cinder-85200 Aug 10 13:40:18.990028 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-e1a1f177-b373-440d-a158-76a7d533e2e2 req-d838f9bd-4a3a-48dd-b502-ba9513a30c39 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079150 Aug 10 13:40:18.991719 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 170/363] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:40:19.063456 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-87681ff1-180f-47b4-a3f7-38aca026e0dc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:19.078980 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-87681ff1-180f-47b4-a3f7-38aca026e0dc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:19.081431 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-87681ff1-180f-47b4-a3f7-38aca026e0dc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:19.082706 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-87681ff1-180f-47b4-a3f7-38aca026e0dc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1741 microversion: 2.20 time: 0.503502 Aug 10 13:40:19.086564 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 194/364] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:18 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1741 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:40:19.292329 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-0885287c-dea1-4202-b236-6aa6454d4269 req-e14505ed-5f7b-4ebd-8a73-d00027a1f4b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45a8ce5d-0dc9-426c-bf2d-d81a99e26e39", "tag": "18644036-6089-4e3d-9098-4284e0ee683c"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:40:19.316258 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-0885287c-dea1-4202-b236-6aa6454d4269 req-e14505ed-5f7b-4ebd-8a73-d00027a1f4b8 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:19.324578 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-0885287c-dea1-4202-b236-6aa6454d4269 req-e14505ed-5f7b-4ebd-8a73-d00027a1f4b8 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:19.325415 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-0885287c-dea1-4202-b236-6aa6454d4269 req-e14505ed-5f7b-4ebd-8a73-d00027a1f4b8 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:19.356774 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-0885287c-dea1-4202-b236-6aa6454d4269 req-e14505ed-5f7b-4ebd-8a73-d00027a1f4b8 service nova] Creating event network-changed:18644036-6089-4e3d-9098-4284e0ee683c for instance 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 on hv-cinder-85200 Aug 10 13:40:19.375850 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-0885287c-dea1-4202-b236-6aa6454d4269 req-e14505ed-5f7b-4ebd-8a73-d00027a1f4b8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088274 Aug 10 13:40:19.376566 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 171/365] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:40:19.597212 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-e9fecb2e-6f5d-49f0-8966-5779163733b4 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:19.598492 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-e9fecb2e-6f5d-49f0-8966-5779163733b4 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:19.606400 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e9fecb2e-6f5d-49f0-8966-5779163733b4 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:19.607227 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e9fecb2e-6f5d-49f0-8966-5779163733b4 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:19.607870 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e9fecb2e-6f5d-49f0-8966-5779163733b4 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:19.608810 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e9fecb2e-6f5d-49f0-8966-5779163733b4 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:19.609507 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e9fecb2e-6f5d-49f0-8966-5779163733b4 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:19.610198 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e9fecb2e-6f5d-49f0-8966-5779163733b4 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:19.633508 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-bcc03dc2-7db5-423b-b1ac-3e3065eea260 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:19.634214 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-bcc03dc2-7db5-423b-b1ac-3e3065eea260 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:19.666797 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bcc03dc2-7db5-423b-b1ac-3e3065eea260 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:19.667470 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bcc03dc2-7db5-423b-b1ac-3e3065eea260 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:19.673479 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bcc03dc2-7db5-423b-b1ac-3e3065eea260 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:19.674614 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bcc03dc2-7db5-423b-b1ac-3e3065eea260 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:19.675311 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bcc03dc2-7db5-423b-b1ac-3e3065eea260 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:19.677767 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bcc03dc2-7db5-423b-b1ac-3e3065eea260 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:19.919138 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-e9fecb2e-6f5d-49f0-8966-5779163733b4 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:19.934188 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-e9fecb2e-6f5d-49f0-8966-5779163733b4 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1697 microversion: 2.1 time: 0.340597 Aug 10 13:40:19.957975 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 195/366] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:19 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1697 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:20.080642 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-ad0b36b7-a132-4f30-87a0-d987a37ef4a7 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:40:20.093177 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ad0b36b7-a132-4f30-87a0-d987a37ef4a7 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:20.094009 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ad0b36b7-a132-4f30-87a0-d987a37ef4a7 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:20.111142 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ad0b36b7-a132-4f30-87a0-d987a37ef4a7 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:20.135424 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell1:SELECT=100 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:40:20.248716 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-ad0b36b7-a132-4f30-87a0-d987a37ef4a7 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Going to try to start instance {{(pid=129522) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 10 13:40:20.326520 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-bcc03dc2-7db5-423b-b1ac-3e3065eea260 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:20.352905 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-bcc03dc2-7db5-423b-b1ac-3e3065eea260 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1358 microversion: 2.1 time: 0.726241 Aug 10 13:40:20.368992 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-ad0b36b7-a132-4f30-87a0-d987a37ef4a7 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "POST /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522/action" status: 202 len: 0 microversion: 2.1 time: 0.398447 Aug 10 13:40:20.368992 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 196/367] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 10 13:40:19 2022] POST /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522/action => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:40:20.377976 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-6c247468-e4fb-4971-af4b-fed582a7f3fd tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:20.378173 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 172/368] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:19 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1358 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:20.378684 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-6c247468-e4fb-4971-af4b-fed582a7f3fd tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:20.396672 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-55c0b00f-a854-4cf5-94a2-1348c2f44cd5 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:20.399330 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-55c0b00f-a854-4cf5-94a2-1348c2f44cd5 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:20.411552 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-55c0b00f-a854-4cf5-94a2-1348c2f44cd5 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:20.412906 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-55c0b00f-a854-4cf5-94a2-1348c2f44cd5 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:20.413759 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-55c0b00f-a854-4cf5-94a2-1348c2f44cd5 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:20.415733 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-55c0b00f-a854-4cf5-94a2-1348c2f44cd5 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:20.417136 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-55c0b00f-a854-4cf5-94a2-1348c2f44cd5 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:20.417939 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-55c0b00f-a854-4cf5-94a2-1348c2f44cd5 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:20.422576 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6c247468-e4fb-4971-af4b-fed582a7f3fd tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:20.426827 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6c247468-e4fb-4971-af4b-fed582a7f3fd tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:20.427460 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6c247468-e4fb-4971-af4b-fed582a7f3fd tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:20.428306 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6c247468-e4fb-4971-af4b-fed582a7f3fd tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:20.429027 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6c247468-e4fb-4971-af4b-fed582a7f3fd tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:20.429564 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6c247468-e4fb-4971-af4b-fed582a7f3fd tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:20.775253 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-55c0b00f-a854-4cf5-94a2-1348c2f44cd5 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:20.786809 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-55c0b00f-a854-4cf5-94a2-1348c2f44cd5 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1706 microversion: 2.1 time: 0.400428 Aug 10 13:40:20.787394 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 173/369] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:20 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1706 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:20.886667 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-6c247468-e4fb-4971-af4b-fed582a7f3fd tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:20.895390 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-6c247468-e4fb-4971-af4b-fed582a7f3fd tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:20.896936 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-6c247468-e4fb-4971-af4b-fed582a7f3fd tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:20.905435 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-6c247468-e4fb-4971-af4b-fed582a7f3fd tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1741 microversion: 2.20 time: 0.537845 Aug 10 13:40:20.929142 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 197/370] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:20 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1741 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:40:21.389846 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-49e9b388-7eab-40ec-9abf-3f7dd7991dc7 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:21.391350 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-49e9b388-7eab-40ec-9abf-3f7dd7991dc7 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:21.407543 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-49e9b388-7eab-40ec-9abf-3f7dd7991dc7 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:21.408299 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-49e9b388-7eab-40ec-9abf-3f7dd7991dc7 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:21.408906 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-49e9b388-7eab-40ec-9abf-3f7dd7991dc7 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:21.411544 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-49e9b388-7eab-40ec-9abf-3f7dd7991dc7 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:21.412168 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-49e9b388-7eab-40ec-9abf-3f7dd7991dc7 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:21.412751 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-49e9b388-7eab-40ec-9abf-3f7dd7991dc7 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:21.640102 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-49e9b388-7eab-40ec-9abf-3f7dd7991dc7 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:21.648835 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-49e9b388-7eab-40ec-9abf-3f7dd7991dc7 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1358 microversion: 2.1 time: 0.263307 Aug 10 13:40:21.649780 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 174/371] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:21 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1358 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:21.818060 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-f7ef3e26-9970-444e-88c7-b7eb842c1295 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:21.819133 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-f7ef3e26-9970-444e-88c7-b7eb842c1295 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:21.836080 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f7ef3e26-9970-444e-88c7-b7eb842c1295 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:21.837964 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f7ef3e26-9970-444e-88c7-b7eb842c1295 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:21.838829 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f7ef3e26-9970-444e-88c7-b7eb842c1295 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:21.840036 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f7ef3e26-9970-444e-88c7-b7eb842c1295 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:21.840836 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f7ef3e26-9970-444e-88c7-b7eb842c1295 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:21.841496 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f7ef3e26-9970-444e-88c7-b7eb842c1295 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:21.929161 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-7c65c956-06a9-4fbc-b8d4-38828b000620 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:21.931418 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-7c65c956-06a9-4fbc-b8d4-38828b000620 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:21.943916 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7c65c956-06a9-4fbc-b8d4-38828b000620 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:21.946527 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7c65c956-06a9-4fbc-b8d4-38828b000620 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:21.949089 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7c65c956-06a9-4fbc-b8d4-38828b000620 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:21.950216 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7c65c956-06a9-4fbc-b8d4-38828b000620 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:21.951365 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7c65c956-06a9-4fbc-b8d4-38828b000620 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:21.953010 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7c65c956-06a9-4fbc-b8d4-38828b000620 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:21.986347 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell1:SELECT=100 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:40:22.070190 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-f7ef3e26-9970-444e-88c7-b7eb842c1295 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:22.084004 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-f7ef3e26-9970-444e-88c7-b7eb842c1295 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1706 microversion: 2.1 time: 0.272398 Aug 10 13:40:22.085177 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 198/372] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:21 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1706 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:22.212954 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-7c65c956-06a9-4fbc-b8d4-38828b000620 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:22.229167 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-7c65c956-06a9-4fbc-b8d4-38828b000620 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:22.231114 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-7c65c956-06a9-4fbc-b8d4-38828b000620 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:22.232636 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-7c65c956-06a9-4fbc-b8d4-38828b000620 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1741 microversion: 2.20 time: 0.308421 Aug 10 13:40:22.245321 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 175/373] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:21 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1741 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:40:22.671727 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-e4488705-384f-450c-ab9e-8a35ff08e983 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:22.672998 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-e4488705-384f-450c-ab9e-8a35ff08e983 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:22.680583 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e4488705-384f-450c-ab9e-8a35ff08e983 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:22.681173 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e4488705-384f-450c-ab9e-8a35ff08e983 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:22.681902 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e4488705-384f-450c-ab9e-8a35ff08e983 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:22.683012 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e4488705-384f-450c-ab9e-8a35ff08e983 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:22.683552 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e4488705-384f-450c-ab9e-8a35ff08e983 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:22.684104 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e4488705-384f-450c-ab9e-8a35ff08e983 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:23.107240 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-9118702a-698f-49bd-9c15-cbc80be37b85 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:23.107240 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-9118702a-698f-49bd-9c15-cbc80be37b85 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:23.117121 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9118702a-698f-49bd-9c15-cbc80be37b85 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:23.117653 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9118702a-698f-49bd-9c15-cbc80be37b85 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:23.118084 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9118702a-698f-49bd-9c15-cbc80be37b85 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:23.118792 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9118702a-698f-49bd-9c15-cbc80be37b85 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:23.119250 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9118702a-698f-49bd-9c15-cbc80be37b85 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:23.119671 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9118702a-698f-49bd-9c15-cbc80be37b85 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:23.333139 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-e4488705-384f-450c-ab9e-8a35ff08e983 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:23.344421 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-e4488705-384f-450c-ab9e-8a35ff08e983 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1358 microversion: 2.1 time: 0.677495 Aug 10 13:40:23.346268 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 199/374] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:22 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1358 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:23.352358 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-e4897d07-285e-477f-b52f-687525bb5668 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:23.353952 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-e4897d07-285e-477f-b52f-687525bb5668 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:23.361325 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e4897d07-285e-477f-b52f-687525bb5668 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:23.362160 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e4897d07-285e-477f-b52f-687525bb5668 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:23.363728 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e4897d07-285e-477f-b52f-687525bb5668 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:23.364823 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e4897d07-285e-477f-b52f-687525bb5668 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:23.365720 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e4897d07-285e-477f-b52f-687525bb5668 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:23.366345 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e4897d07-285e-477f-b52f-687525bb5668 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:23.469000 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-9118702a-698f-49bd-9c15-cbc80be37b85 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:23.478196 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-9118702a-698f-49bd-9c15-cbc80be37b85 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1706 microversion: 2.1 time: 0.375644 Aug 10 13:40:23.478783 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 176/375] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:23 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1706 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:40:23.547649 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-e4897d07-285e-477f-b52f-687525bb5668 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:23.558945 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-e4897d07-285e-477f-b52f-687525bb5668 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:23.561462 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-e4897d07-285e-477f-b52f-687525bb5668 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:23.563425 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-e4897d07-285e-477f-b52f-687525bb5668 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1741 microversion: 2.20 time: 0.215890 Aug 10 13:40:23.564440 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 200/376] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:23 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1741 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:40:24.372354 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-d93cc939-79d9-4d09-8ac7-d03039c27721 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:24.373675 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-d93cc939-79d9-4d09-8ac7-d03039c27721 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:24.379867 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell0:SELECT=2 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:40:24.381203 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell0:SELECT=12 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:40:24.383955 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d93cc939-79d9-4d09-8ac7-d03039c27721 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:24.384639 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d93cc939-79d9-4d09-8ac7-d03039c27721 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:24.385421 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d93cc939-79d9-4d09-8ac7-d03039c27721 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:24.386312 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d93cc939-79d9-4d09-8ac7-d03039c27721 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:24.387082 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d93cc939-79d9-4d09-8ac7-d03039c27721 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:24.387659 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d93cc939-79d9-4d09-8ac7-d03039c27721 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:24.499643 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-14008531-4335-497c-a73a-17e5dfdc4181 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:24.500591 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-14008531-4335-497c-a73a-17e5dfdc4181 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:24.510599 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-14008531-4335-497c-a73a-17e5dfdc4181 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:24.516458 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-14008531-4335-497c-a73a-17e5dfdc4181 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:24.517062 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-14008531-4335-497c-a73a-17e5dfdc4181 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:24.518044 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-14008531-4335-497c-a73a-17e5dfdc4181 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:24.518795 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-14008531-4335-497c-a73a-17e5dfdc4181 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:24.519065 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-14008531-4335-497c-a73a-17e5dfdc4181 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:24.579772 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-d93cc939-79d9-4d09-8ac7-d03039c27721 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:24.597264 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-d93cc939-79d9-4d09-8ac7-d03039c27721 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1358 microversion: 2.1 time: 0.221665 Aug 10 13:40:24.601675 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 177/377] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:24 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:24.607174 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-88dfef08-9559-4381-8353-f85acc764cca tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:24.607975 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-88dfef08-9559-4381-8353-f85acc764cca tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:24.617864 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-88dfef08-9559-4381-8353-f85acc764cca tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:24.618902 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-88dfef08-9559-4381-8353-f85acc764cca tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:24.619852 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-88dfef08-9559-4381-8353-f85acc764cca tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:24.620941 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-88dfef08-9559-4381-8353-f85acc764cca tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:24.621659 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-88dfef08-9559-4381-8353-f85acc764cca tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:24.622317 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-88dfef08-9559-4381-8353-f85acc764cca tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:24.727765 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-14008531-4335-497c-a73a-17e5dfdc4181 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:24.736310 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-14008531-4335-497c-a73a-17e5dfdc4181 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1706 microversion: 2.1 time: 0.240429 Aug 10 13:40:24.747412 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 201/378] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:24 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1706 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:40:24.829475 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-88dfef08-9559-4381-8353-f85acc764cca tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:24.843534 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-88dfef08-9559-4381-8353-f85acc764cca tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:24.845543 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-88dfef08-9559-4381-8353-f85acc764cca tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:24.847460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-88dfef08-9559-4381-8353-f85acc764cca tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1741 microversion: 2.20 time: 0.244048 Aug 10 13:40:24.848095 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 178/379] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:24 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1741 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:40:25.620367 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-76ca6c4f-e160-43a8-b7ea-97fbe2ed5d4b tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:25.620919 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-76ca6c4f-e160-43a8-b7ea-97fbe2ed5d4b tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:25.627276 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-76ca6c4f-e160-43a8-b7ea-97fbe2ed5d4b tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:25.627754 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-76ca6c4f-e160-43a8-b7ea-97fbe2ed5d4b tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:25.628179 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-76ca6c4f-e160-43a8-b7ea-97fbe2ed5d4b tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:25.628890 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-76ca6c4f-e160-43a8-b7ea-97fbe2ed5d4b tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:25.629362 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-76ca6c4f-e160-43a8-b7ea-97fbe2ed5d4b tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:25.629776 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-76ca6c4f-e160-43a8-b7ea-97fbe2ed5d4b tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:25.758750 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-646eedfd-6193-47b8-9372-787fdb636daf tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:25.759487 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-646eedfd-6193-47b8-9372-787fdb636daf tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:25.765871 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-646eedfd-6193-47b8-9372-787fdb636daf tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:25.766363 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-646eedfd-6193-47b8-9372-787fdb636daf tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:25.766926 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-646eedfd-6193-47b8-9372-787fdb636daf tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:25.767641 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-646eedfd-6193-47b8-9372-787fdb636daf tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:25.768098 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-646eedfd-6193-47b8-9372-787fdb636daf tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:25.768523 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-646eedfd-6193-47b8-9372-787fdb636daf tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:25.795025 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-76ca6c4f-e160-43a8-b7ea-97fbe2ed5d4b tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:25.815519 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-76ca6c4f-e160-43a8-b7ea-97fbe2ed5d4b tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1358 microversion: 2.1 time: 0.188538 Aug 10 13:40:25.816461 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 202/380] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:25 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:40:25.872470 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-b34e7ad9-967a-4d9c-895a-d21119cf3255 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:25.873209 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-b34e7ad9-967a-4d9c-895a-d21119cf3255 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:25.879730 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b34e7ad9-967a-4d9c-895a-d21119cf3255 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:25.880376 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b34e7ad9-967a-4d9c-895a-d21119cf3255 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:25.880817 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b34e7ad9-967a-4d9c-895a-d21119cf3255 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:25.881537 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b34e7ad9-967a-4d9c-895a-d21119cf3255 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:25.881990 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b34e7ad9-967a-4d9c-895a-d21119cf3255 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:25.882497 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b34e7ad9-967a-4d9c-895a-d21119cf3255 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:25.916113 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-646eedfd-6193-47b8-9372-787fdb636daf tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:25.934651 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-646eedfd-6193-47b8-9372-787fdb636daf tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1706 microversion: 2.1 time: 0.179565 Aug 10 13:40:25.935962 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 179/381] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:25 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1706 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:40:26.029419 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-b34e7ad9-967a-4d9c-895a-d21119cf3255 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:26.040410 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-b34e7ad9-967a-4d9c-895a-d21119cf3255 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:26.041948 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-b34e7ad9-967a-4d9c-895a-d21119cf3255 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:26.043148 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-b34e7ad9-967a-4d9c-895a-d21119cf3255 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1741 microversion: 2.20 time: 0.175762 Aug 10 13:40:26.043934 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 203/382] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:25 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1741 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:40:26.836289 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-ea3ff43e-abb2-4c49-9b05-c93e63618a10 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:26.836904 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-ea3ff43e-abb2-4c49-9b05-c93e63618a10 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:26.843577 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ea3ff43e-abb2-4c49-9b05-c93e63618a10 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:26.844061 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ea3ff43e-abb2-4c49-9b05-c93e63618a10 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:26.844527 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ea3ff43e-abb2-4c49-9b05-c93e63618a10 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:26.845221 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ea3ff43e-abb2-4c49-9b05-c93e63618a10 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:26.845696 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ea3ff43e-abb2-4c49-9b05-c93e63618a10 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:26.846118 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ea3ff43e-abb2-4c49-9b05-c93e63618a10 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:26.956224 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-9d94d694-2ef1-438c-840a-392bfd2534fa tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:26.957453 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-9d94d694-2ef1-438c-840a-392bfd2534fa tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:26.964162 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9d94d694-2ef1-438c-840a-392bfd2534fa tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:26.964644 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9d94d694-2ef1-438c-840a-392bfd2534fa tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:26.965077 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9d94d694-2ef1-438c-840a-392bfd2534fa tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:26.965804 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9d94d694-2ef1-438c-840a-392bfd2534fa tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:26.966278 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9d94d694-2ef1-438c-840a-392bfd2534fa tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:26.966703 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9d94d694-2ef1-438c-840a-392bfd2534fa tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:27.012241 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-ea3ff43e-abb2-4c49-9b05-c93e63618a10 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:27.020214 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-ea3ff43e-abb2-4c49-9b05-c93e63618a10 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1358 microversion: 2.1 time: 0.187802 Aug 10 13:40:27.020832 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 180/383] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:26 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:27.069073 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-942cc108-eb50-47e1-8181-4ff1495c74ee tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:27.069667 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-942cc108-eb50-47e1-8181-4ff1495c74ee tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:27.075704 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-942cc108-eb50-47e1-8181-4ff1495c74ee tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:27.076185 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-942cc108-eb50-47e1-8181-4ff1495c74ee tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:27.076613 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-942cc108-eb50-47e1-8181-4ff1495c74ee tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:27.077333 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-942cc108-eb50-47e1-8181-4ff1495c74ee tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:27.077786 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-942cc108-eb50-47e1-8181-4ff1495c74ee tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:27.078205 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-942cc108-eb50-47e1-8181-4ff1495c74ee tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:27.109981 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-9d94d694-2ef1-438c-840a-392bfd2534fa tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:27.120123 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-9d94d694-2ef1-438c-840a-392bfd2534fa tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1706 microversion: 2.1 time: 0.167962 Aug 10 13:40:27.130982 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 204/384] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:26 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1706 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:40:27.215857 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-942cc108-eb50-47e1-8181-4ff1495c74ee tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:27.225531 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-942cc108-eb50-47e1-8181-4ff1495c74ee tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:27.227030 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-942cc108-eb50-47e1-8181-4ff1495c74ee tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:27.228201 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-942cc108-eb50-47e1-8181-4ff1495c74ee tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1741 microversion: 2.20 time: 0.164102 Aug 10 13:40:27.228973 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 181/385] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:27 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1741 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:40:28.043409 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-659f20ec-d70a-4b8f-825b-8a69544500b4 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:28.043986 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-659f20ec-d70a-4b8f-825b-8a69544500b4 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:28.050499 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-659f20ec-d70a-4b8f-825b-8a69544500b4 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:28.050986 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-659f20ec-d70a-4b8f-825b-8a69544500b4 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:28.051428 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-659f20ec-d70a-4b8f-825b-8a69544500b4 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:28.052115 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-659f20ec-d70a-4b8f-825b-8a69544500b4 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:28.052567 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-659f20ec-d70a-4b8f-825b-8a69544500b4 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:28.052986 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-659f20ec-d70a-4b8f-825b-8a69544500b4 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:28.141827 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-7b6221da-c17d-4dda-b696-3432ecce3b4f tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:28.142448 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-7b6221da-c17d-4dda-b696-3432ecce3b4f tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:28.150578 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7b6221da-c17d-4dda-b696-3432ecce3b4f tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:28.151228 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7b6221da-c17d-4dda-b696-3432ecce3b4f tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:28.151673 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7b6221da-c17d-4dda-b696-3432ecce3b4f tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:28.152380 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7b6221da-c17d-4dda-b696-3432ecce3b4f tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:28.152840 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7b6221da-c17d-4dda-b696-3432ecce3b4f tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:28.153276 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7b6221da-c17d-4dda-b696-3432ecce3b4f tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:28.192361 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-659f20ec-d70a-4b8f-825b-8a69544500b4 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:28.200127 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-659f20ec-d70a-4b8f-825b-8a69544500b4 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1358 microversion: 2.1 time: 0.160709 Aug 10 13:40:28.200915 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 205/386] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:28 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:28.251720 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-8d2d6bd5-d695-44e3-8970-48e2ef814371 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:28.252443 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-8d2d6bd5-d695-44e3-8970-48e2ef814371 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:28.258391 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8d2d6bd5-d695-44e3-8970-48e2ef814371 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:28.258874 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8d2d6bd5-d695-44e3-8970-48e2ef814371 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:28.259955 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8d2d6bd5-d695-44e3-8970-48e2ef814371 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:28.260656 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8d2d6bd5-d695-44e3-8970-48e2ef814371 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:28.261110 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8d2d6bd5-d695-44e3-8970-48e2ef814371 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:28.261588 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8d2d6bd5-d695-44e3-8970-48e2ef814371 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:28.297379 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-7b6221da-c17d-4dda-b696-3432ecce3b4f tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:28.306050 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-7b6221da-c17d-4dda-b696-3432ecce3b4f tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1706 microversion: 2.1 time: 0.168251 Aug 10 13:40:28.309621 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 182/387] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:28 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1706 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:40:28.412838 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-8d2d6bd5-d695-44e3-8970-48e2ef814371 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:28.421444 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-8d2d6bd5-d695-44e3-8970-48e2ef814371 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:28.422947 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-8d2d6bd5-d695-44e3-8970-48e2ef814371 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:28.424107 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-8d2d6bd5-d695-44e3-8970-48e2ef814371 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1741 microversion: 2.20 time: 0.176363 Aug 10 13:40:28.424688 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 206/388] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:28 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1741 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:40:29.222175 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-00ff8ba8-2817-4af8-ba70-833f0f23b5a9 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:29.223391 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-00ff8ba8-2817-4af8-ba70-833f0f23b5a9 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:29.230226 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-00ff8ba8-2817-4af8-ba70-833f0f23b5a9 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:29.230716 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-00ff8ba8-2817-4af8-ba70-833f0f23b5a9 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:29.231182 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-00ff8ba8-2817-4af8-ba70-833f0f23b5a9 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:29.231887 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-00ff8ba8-2817-4af8-ba70-833f0f23b5a9 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:29.232341 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-00ff8ba8-2817-4af8-ba70-833f0f23b5a9 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:29.232766 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-00ff8ba8-2817-4af8-ba70-833f0f23b5a9 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:29.326625 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-c8529c41-bf40-423d-a15e-50e08767874d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:29.327242 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-c8529c41-bf40-423d-a15e-50e08767874d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:29.335113 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c8529c41-bf40-423d-a15e-50e08767874d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:29.335863 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c8529c41-bf40-423d-a15e-50e08767874d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:29.336307 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c8529c41-bf40-423d-a15e-50e08767874d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:29.337027 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c8529c41-bf40-423d-a15e-50e08767874d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:29.337605 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c8529c41-bf40-423d-a15e-50e08767874d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:29.338026 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c8529c41-bf40-423d-a15e-50e08767874d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:29.373255 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-00ff8ba8-2817-4af8-ba70-833f0f23b5a9 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:29.381245 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-00ff8ba8-2817-4af8-ba70-833f0f23b5a9 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1358 microversion: 2.1 time: 0.162848 Aug 10 13:40:29.381966 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 183/389] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:29 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:29.450658 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-ee471861-adf8-4a49-87c5-b44e375fba5a tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:29.451784 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-ee471861-adf8-4a49-87c5-b44e375fba5a tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:29.458979 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ee471861-adf8-4a49-87c5-b44e375fba5a tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:29.459883 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ee471861-adf8-4a49-87c5-b44e375fba5a tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:29.460536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ee471861-adf8-4a49-87c5-b44e375fba5a tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:29.461561 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ee471861-adf8-4a49-87c5-b44e375fba5a tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:29.462224 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ee471861-adf8-4a49-87c5-b44e375fba5a tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:29.462712 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ee471861-adf8-4a49-87c5-b44e375fba5a tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:29.505789 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-c8529c41-bf40-423d-a15e-50e08767874d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:29.514547 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-c8529c41-bf40-423d-a15e-50e08767874d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1706 microversion: 2.1 time: 0.192060 Aug 10 13:40:29.515122 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 207/390] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:29 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1706 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:29.598032 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-ee471861-adf8-4a49-87c5-b44e375fba5a tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:29.605835 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-ee471861-adf8-4a49-87c5-b44e375fba5a tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:29.607339 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-ee471861-adf8-4a49-87c5-b44e375fba5a tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:29.608485 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-ee471861-adf8-4a49-87c5-b44e375fba5a tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1741 microversion: 2.20 time: 0.162126 Aug 10 13:40:29.609049 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 184/391] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:29 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1741 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:40:30.403027 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-4fc35894-69be-44d4-815f-e1a67ad79d7c tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:30.404074 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-4fc35894-69be-44d4-815f-e1a67ad79d7c tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:30.411135 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4fc35894-69be-44d4-815f-e1a67ad79d7c tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:30.411616 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4fc35894-69be-44d4-815f-e1a67ad79d7c tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:30.412046 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4fc35894-69be-44d4-815f-e1a67ad79d7c tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:30.412738 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4fc35894-69be-44d4-815f-e1a67ad79d7c tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:30.413185 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4fc35894-69be-44d4-815f-e1a67ad79d7c tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:30.413624 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4fc35894-69be-44d4-815f-e1a67ad79d7c tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:30.537667 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-e7ec9f8e-6911-4ec1-921e-282ee37c0d6a tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:30.541642 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-e7ec9f8e-6911-4ec1-921e-282ee37c0d6a tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:30.551233 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e7ec9f8e-6911-4ec1-921e-282ee37c0d6a tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:30.551439 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-4fc35894-69be-44d4-815f-e1a67ad79d7c tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:30.551715 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e7ec9f8e-6911-4ec1-921e-282ee37c0d6a tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:30.552181 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e7ec9f8e-6911-4ec1-921e-282ee37c0d6a tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:30.552918 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e7ec9f8e-6911-4ec1-921e-282ee37c0d6a tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:30.553315 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e7ec9f8e-6911-4ec1-921e-282ee37c0d6a tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:30.553739 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e7ec9f8e-6911-4ec1-921e-282ee37c0d6a tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:30.559733 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-4fc35894-69be-44d4-815f-e1a67ad79d7c tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1358 microversion: 2.1 time: 0.161016 Aug 10 13:40:30.560637 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 208/392] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:30 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:30.632815 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-49e4fd88-d871-46ea-a307-3ea3d796b127 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:30.633458 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-49e4fd88-d871-46ea-a307-3ea3d796b127 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:30.639427 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-49e4fd88-d871-46ea-a307-3ea3d796b127 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:30.639846 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-49e4fd88-d871-46ea-a307-3ea3d796b127 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:30.640285 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-49e4fd88-d871-46ea-a307-3ea3d796b127 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:30.640981 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-49e4fd88-d871-46ea-a307-3ea3d796b127 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:30.641468 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-49e4fd88-d871-46ea-a307-3ea3d796b127 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:30.641894 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-49e4fd88-d871-46ea-a307-3ea3d796b127 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:30.690110 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-e7ec9f8e-6911-4ec1-921e-282ee37c0d6a tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:30.698696 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-e7ec9f8e-6911-4ec1-921e-282ee37c0d6a tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1706 microversion: 2.1 time: 0.166603 Aug 10 13:40:30.699296 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 185/393] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:30 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1706 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:30.771163 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-49e4fd88-d871-46ea-a307-3ea3d796b127 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:30.778975 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-49e4fd88-d871-46ea-a307-3ea3d796b127 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:30.780481 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-49e4fd88-d871-46ea-a307-3ea3d796b127 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:30.781714 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-49e4fd88-d871-46ea-a307-3ea3d796b127 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1741 microversion: 2.20 time: 0.153448 Aug 10 13:40:30.782222 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 209/394] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:30 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1741 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:40:31.580430 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-08c20047-1522-4cb4-9973-8cef3d57e1cb tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:31.581030 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-08c20047-1522-4cb4-9973-8cef3d57e1cb tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:31.588000 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-08c20047-1522-4cb4-9973-8cef3d57e1cb tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:31.588474 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-08c20047-1522-4cb4-9973-8cef3d57e1cb tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:31.588990 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-08c20047-1522-4cb4-9973-8cef3d57e1cb tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:31.589696 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-08c20047-1522-4cb4-9973-8cef3d57e1cb tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:31.590145 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-08c20047-1522-4cb4-9973-8cef3d57e1cb tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:31.590562 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-08c20047-1522-4cb4-9973-8cef3d57e1cb tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:31.714442 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-08c20047-1522-4cb4-9973-8cef3d57e1cb tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:31.720238 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-38919b21-c81e-46a8-a1d6-c6894ed3b88c tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:31.720879 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-38919b21-c81e-46a8-a1d6-c6894ed3b88c tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:31.721756 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-08c20047-1522-4cb4-9973-8cef3d57e1cb tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1358 microversion: 2.1 time: 0.145133 Aug 10 13:40:31.722894 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 186/395] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:31 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:31.727586 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-38919b21-c81e-46a8-a1d6-c6894ed3b88c tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:31.728071 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-38919b21-c81e-46a8-a1d6-c6894ed3b88c tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:31.728533 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-38919b21-c81e-46a8-a1d6-c6894ed3b88c tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:31.729252 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-38919b21-c81e-46a8-a1d6-c6894ed3b88c tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:31.729701 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-38919b21-c81e-46a8-a1d6-c6894ed3b88c tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:31.730123 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-38919b21-c81e-46a8-a1d6-c6894ed3b88c tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:31.804639 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-9ef4dc6f-8069-4a64-9c9a-af7dcf5ff4bc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:31.805450 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-9ef4dc6f-8069-4a64-9c9a-af7dcf5ff4bc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:31.811264 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9ef4dc6f-8069-4a64-9c9a-af7dcf5ff4bc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:31.811754 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9ef4dc6f-8069-4a64-9c9a-af7dcf5ff4bc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:31.812222 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9ef4dc6f-8069-4a64-9c9a-af7dcf5ff4bc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:31.812915 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9ef4dc6f-8069-4a64-9c9a-af7dcf5ff4bc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:31.813398 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9ef4dc6f-8069-4a64-9c9a-af7dcf5ff4bc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:31.813827 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9ef4dc6f-8069-4a64-9c9a-af7dcf5ff4bc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:31.862015 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-38919b21-c81e-46a8-a1d6-c6894ed3b88c tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:31.871194 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-38919b21-c81e-46a8-a1d6-c6894ed3b88c tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1710 microversion: 2.1 time: 0.154730 Aug 10 13:40:31.871784 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 210/396] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:31 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1710 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:40:31.944350 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-9ef4dc6f-8069-4a64-9c9a-af7dcf5ff4bc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:31.952094 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-9ef4dc6f-8069-4a64-9c9a-af7dcf5ff4bc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:31.953656 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-9ef4dc6f-8069-4a64-9c9a-af7dcf5ff4bc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:31.954809 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-9ef4dc6f-8069-4a64-9c9a-af7dcf5ff4bc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1741 microversion: 2.20 time: 0.154808 Aug 10 13:40:31.955361 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 187/397] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:31 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1741 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:40:32.743531 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-145555ba-528c-4f88-869e-3e79a4af3f27 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:32.744139 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-145555ba-528c-4f88-869e-3e79a4af3f27 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:32.750583 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-145555ba-528c-4f88-869e-3e79a4af3f27 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:32.751063 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-145555ba-528c-4f88-869e-3e79a4af3f27 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:32.751492 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-145555ba-528c-4f88-869e-3e79a4af3f27 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:32.752176 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-145555ba-528c-4f88-869e-3e79a4af3f27 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:32.752626 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-145555ba-528c-4f88-869e-3e79a4af3f27 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:32.753044 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-145555ba-528c-4f88-869e-3e79a4af3f27 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:32.877125 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-145555ba-528c-4f88-869e-3e79a4af3f27 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:32.879453 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:40:32.886427 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-145555ba-528c-4f88-869e-3e79a4af3f27 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1358 microversion: 2.1 time: 0.146749 Aug 10 13:40:32.887198 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 211/398] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:32 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:32.978358 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-f0837192-eba0-4be1-8650-e7a87e75e418 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:32.978991 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-f0837192-eba0-4be1-8650-e7a87e75e418 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:32.986698 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f0837192-eba0-4be1-8650-e7a87e75e418 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:32.987182 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f0837192-eba0-4be1-8650-e7a87e75e418 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:32.987863 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f0837192-eba0-4be1-8650-e7a87e75e418 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:32.989449 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f0837192-eba0-4be1-8650-e7a87e75e418 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:32.989906 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f0837192-eba0-4be1-8650-e7a87e75e418 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:32.990328 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f0837192-eba0-4be1-8650-e7a87e75e418 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:33.118111 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-f0837192-eba0-4be1-8650-e7a87e75e418 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:33.126127 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-f0837192-eba0-4be1-8650-e7a87e75e418 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:33.127640 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-f0837192-eba0-4be1-8650-e7a87e75e418 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:33.128811 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-f0837192-eba0-4be1-8650-e7a87e75e418 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1723 microversion: 2.20 time: 0.154331 Aug 10 13:40:33.129397 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 188/399] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:32 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:40:33.907643 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-8d20818c-bf72-4efb-b23f-c360ce64d3b9 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:33.908300 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-8d20818c-bf72-4efb-b23f-c360ce64d3b9 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:33.916804 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8d20818c-bf72-4efb-b23f-c360ce64d3b9 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:33.917300 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8d20818c-bf72-4efb-b23f-c360ce64d3b9 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:33.917729 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8d20818c-bf72-4efb-b23f-c360ce64d3b9 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:33.918413 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8d20818c-bf72-4efb-b23f-c360ce64d3b9 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:33.918859 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8d20818c-bf72-4efb-b23f-c360ce64d3b9 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:33.919274 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8d20818c-bf72-4efb-b23f-c360ce64d3b9 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:34.118419 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-8d20818c-bf72-4efb-b23f-c360ce64d3b9 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:34.125930 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-8d20818c-bf72-4efb-b23f-c360ce64d3b9 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1358 microversion: 2.1 time: 0.222295 Aug 10 13:40:34.126503 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 212/400] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:33 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1358 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:34.152099 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-aada4200-f2ac-44ea-b130-514b186bcb76 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:34.152682 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-aada4200-f2ac-44ea-b130-514b186bcb76 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:34.159133 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-aada4200-f2ac-44ea-b130-514b186bcb76 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:34.159614 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-aada4200-f2ac-44ea-b130-514b186bcb76 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:34.160045 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-aada4200-f2ac-44ea-b130-514b186bcb76 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:34.160848 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-aada4200-f2ac-44ea-b130-514b186bcb76 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:34.161505 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-aada4200-f2ac-44ea-b130-514b186bcb76 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:34.162080 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-aada4200-f2ac-44ea-b130-514b186bcb76 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:34.295144 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-aada4200-f2ac-44ea-b130-514b186bcb76 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:34.303413 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-aada4200-f2ac-44ea-b130-514b186bcb76 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:34.304906 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-aada4200-f2ac-44ea-b130-514b186bcb76 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:34.306160 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-aada4200-f2ac-44ea-b130-514b186bcb76 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1723 microversion: 2.20 time: 0.158068 Aug 10 13:40:34.306712 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 189/401] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:34 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:40:35.150330 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-a735ad7c-511e-4827-9f74-ad89b8596b58 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:35.150964 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-a735ad7c-511e-4827-9f74-ad89b8596b58 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:35.157487 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a735ad7c-511e-4827-9f74-ad89b8596b58 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:35.157963 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a735ad7c-511e-4827-9f74-ad89b8596b58 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:35.158388 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a735ad7c-511e-4827-9f74-ad89b8596b58 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:35.159061 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a735ad7c-511e-4827-9f74-ad89b8596b58 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:35.159534 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a735ad7c-511e-4827-9f74-ad89b8596b58 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:35.159964 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a735ad7c-511e-4827-9f74-ad89b8596b58 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:35.284059 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-a735ad7c-511e-4827-9f74-ad89b8596b58 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:35.291857 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-a735ad7c-511e-4827-9f74-ad89b8596b58 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1358 microversion: 2.1 time: 0.145424 Aug 10 13:40:35.292441 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 213/402] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:35 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:35.328714 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-8841f4fe-f84f-402f-9575-c6de522f45f6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:35.329358 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-8841f4fe-f84f-402f-9575-c6de522f45f6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:35.335837 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8841f4fe-f84f-402f-9575-c6de522f45f6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:35.336321 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8841f4fe-f84f-402f-9575-c6de522f45f6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:35.336751 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8841f4fe-f84f-402f-9575-c6de522f45f6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:35.337459 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8841f4fe-f84f-402f-9575-c6de522f45f6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:35.337911 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8841f4fe-f84f-402f-9575-c6de522f45f6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:35.338332 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8841f4fe-f84f-402f-9575-c6de522f45f6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:35.480567 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-8841f4fe-f84f-402f-9575-c6de522f45f6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:35.490108 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-8841f4fe-f84f-402f-9575-c6de522f45f6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:35.491615 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-8841f4fe-f84f-402f-9575-c6de522f45f6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:35.492843 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-8841f4fe-f84f-402f-9575-c6de522f45f6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1723 microversion: 2.20 time: 0.167918 Aug 10 13:40:35.493432 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 190/403] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:35 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:40:36.313288 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-c62b8a84-86f2-47d1-9dad-e48c9ae604d3 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:36.313931 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-c62b8a84-86f2-47d1-9dad-e48c9ae604d3 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:36.320926 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c62b8a84-86f2-47d1-9dad-e48c9ae604d3 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:36.321441 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c62b8a84-86f2-47d1-9dad-e48c9ae604d3 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:36.321872 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c62b8a84-86f2-47d1-9dad-e48c9ae604d3 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:36.322566 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c62b8a84-86f2-47d1-9dad-e48c9ae604d3 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:36.323140 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c62b8a84-86f2-47d1-9dad-e48c9ae604d3 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:36.323582 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c62b8a84-86f2-47d1-9dad-e48c9ae604d3 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:36.454163 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-c62b8a84-86f2-47d1-9dad-e48c9ae604d3 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:36.461572 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-c62b8a84-86f2-47d1-9dad-e48c9ae604d3 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1358 microversion: 2.1 time: 0.152239 Aug 10 13:40:36.462132 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 214/404] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:36 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:36.516187 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-46a6c5ef-29c8-4bee-84a4-23602f3e36fb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:36.516791 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-46a6c5ef-29c8-4bee-84a4-23602f3e36fb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:36.523805 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-46a6c5ef-29c8-4bee-84a4-23602f3e36fb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:36.524281 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-46a6c5ef-29c8-4bee-84a4-23602f3e36fb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:36.524708 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-46a6c5ef-29c8-4bee-84a4-23602f3e36fb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:36.525421 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-46a6c5ef-29c8-4bee-84a4-23602f3e36fb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:36.525871 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-46a6c5ef-29c8-4bee-84a4-23602f3e36fb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:36.526288 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-46a6c5ef-29c8-4bee-84a4-23602f3e36fb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:36.655191 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-46a6c5ef-29c8-4bee-84a4-23602f3e36fb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:36.658787 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell1:SELECT=100 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:40:36.664720 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-46a6c5ef-29c8-4bee-84a4-23602f3e36fb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:36.666331 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-46a6c5ef-29c8-4bee-84a4-23602f3e36fb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:36.667490 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-46a6c5ef-29c8-4bee-84a4-23602f3e36fb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1726 microversion: 2.20 time: 0.155119 Aug 10 13:40:36.668300 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 191/405] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:36 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:40:36.697052 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-21465a29-a524-4fda-9f63-d0fd1c1d4ed2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11ea44ee-11b0-46db-b933-20dd4590413b"}} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:40:36.699603 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-21465a29-a524-4fda-9f63-d0fd1c1d4ed2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:36.701573 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_api:SELECT=84 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:40:36.707421 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-21465a29-a524-4fda-9f63-d0fd1c1d4ed2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:36.707902 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-21465a29-a524-4fda-9f63-d0fd1c1d4ed2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:36.708335 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-21465a29-a524-4fda-9f63-d0fd1c1d4ed2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:36.709024 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-21465a29-a524-4fda-9f63-d0fd1c1d4ed2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:36.709504 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-21465a29-a524-4fda-9f63-d0fd1c1d4ed2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:36.709927 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-21465a29-a524-4fda-9f63-d0fd1c1d4ed2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:36.988278 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-21465a29-a524-4fda-9f63-d0fd1c1d4ed2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "POST /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.295036 Aug 10 13:40:36.988927 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 215/406] 10.222.0.52 () {62 vars in 1364 bytes} [Wed Aug 10 13:40:36 2022] POST /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb/os-volume_attachments => generated 188 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 13:40:37.109525 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-977d6a56-1bbe-4165-86c6-2c21d1376840 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:40:37.110122 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-977d6a56-1bbe-4165-86c6-2c21d1376840 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:37.116296 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-977d6a56-1bbe-4165-86c6-2c21d1376840 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:37.116782 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-977d6a56-1bbe-4165-86c6-2c21d1376840 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:37.117219 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-977d6a56-1bbe-4165-86c6-2c21d1376840 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:37.117996 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-977d6a56-1bbe-4165-86c6-2c21d1376840 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:37.118454 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-977d6a56-1bbe-4165-86c6-2c21d1376840 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:37.118877 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-977d6a56-1bbe-4165-86c6-2c21d1376840 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:37.162096 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-977d6a56-1bbe-4165-86c6-2c21d1376840 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129523) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 10 13:40:37.226611 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-977d6a56-1bbe-4165-86c6-2c21d1376840 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "POST /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb/action" status: 202 len: 0 microversion: 2.20 time: 0.121300 Aug 10 13:40:37.227198 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 192/407] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Aug 10 13:40:37 2022] POST /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:40:37.235145 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-e3a4bf78-a44b-4b1d-9810-3ef9272019fe tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:37.235781 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-e3a4bf78-a44b-4b1d-9810-3ef9272019fe tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:37.242674 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e3a4bf78-a44b-4b1d-9810-3ef9272019fe tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:37.243157 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e3a4bf78-a44b-4b1d-9810-3ef9272019fe tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:37.243586 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e3a4bf78-a44b-4b1d-9810-3ef9272019fe tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:37.244276 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e3a4bf78-a44b-4b1d-9810-3ef9272019fe tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:37.244724 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e3a4bf78-a44b-4b1d-9810-3ef9272019fe tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:37.245140 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e3a4bf78-a44b-4b1d-9810-3ef9272019fe tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:37.381665 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-e3a4bf78-a44b-4b1d-9810-3ef9272019fe tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:37.390344 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-e3a4bf78-a44b-4b1d-9810-3ef9272019fe tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:37.391858 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-e3a4bf78-a44b-4b1d-9810-3ef9272019fe tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:37.393035 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-e3a4bf78-a44b-4b1d-9810-3ef9272019fe tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1752 microversion: 2.20 time: 0.161705 Aug 10 13:40:37.393625 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 216/408] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:37 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:40:37.482544 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-a3ac2ad9-cacc-47d1-a6bf-5a034980cc80 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:37.483156 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-a3ac2ad9-cacc-47d1-a6bf-5a034980cc80 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:37.489518 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a3ac2ad9-cacc-47d1-a6bf-5a034980cc80 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:37.490001 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a3ac2ad9-cacc-47d1-a6bf-5a034980cc80 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:37.490432 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a3ac2ad9-cacc-47d1-a6bf-5a034980cc80 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:37.491300 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a3ac2ad9-cacc-47d1-a6bf-5a034980cc80 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:37.491754 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a3ac2ad9-cacc-47d1-a6bf-5a034980cc80 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:37.492172 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a3ac2ad9-cacc-47d1-a6bf-5a034980cc80 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:37.539458 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-89f887b7-a4c7-4b13-a07e-e17fabe763e6 req-253e0959-8fca-421f-bf37-7675fd884f14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45a8ce5d-0dc9-426c-bf2d-d81a99e26e39", "name": "network-vif-plugged", "status": "completed", "tag": "18644036-6089-4e3d-9098-4284e0ee683c"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:40:37.559943 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-89f887b7-a4c7-4b13-a07e-e17fabe763e6 req-253e0959-8fca-421f-bf37-7675fd884f14 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:37.560535 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-89f887b7-a4c7-4b13-a07e-e17fabe763e6 req-253e0959-8fca-421f-bf37-7675fd884f14 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:37.561152 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-89f887b7-a4c7-4b13-a07e-e17fabe763e6 req-253e0959-8fca-421f-bf37-7675fd884f14 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:37.574160 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-89f887b7-a4c7-4b13-a07e-e17fabe763e6 req-253e0959-8fca-421f-bf37-7675fd884f14 service nova] Creating event network-vif-plugged:18644036-6089-4e3d-9098-4284e0ee683c for instance 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 on hv-cinder-85200 Aug 10 13:40:37.579835 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-89f887b7-a4c7-4b13-a07e-e17fabe763e6 req-253e0959-8fca-421f-bf37-7675fd884f14 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050771 Aug 10 13:40:37.580969 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 217/409] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:40:37.679997 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-a3ac2ad9-cacc-47d1-a6bf-5a034980cc80 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:37.689862 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-a3ac2ad9-cacc-47d1-a6bf-5a034980cc80 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1358 microversion: 2.1 time: 0.211097 Aug 10 13:40:37.702151 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 193/410] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:37 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:38.418203 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-24599a2c-d74b-471e-82e7-ed47e535bb57 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:38.418929 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-24599a2c-d74b-471e-82e7-ed47e535bb57 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:38.424992 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-24599a2c-d74b-471e-82e7-ed47e535bb57 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:38.426193 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-24599a2c-d74b-471e-82e7-ed47e535bb57 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:38.426627 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-24599a2c-d74b-471e-82e7-ed47e535bb57 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:38.427308 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-24599a2c-d74b-471e-82e7-ed47e535bb57 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:38.427755 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-24599a2c-d74b-471e-82e7-ed47e535bb57 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:38.428171 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-24599a2c-d74b-471e-82e7-ed47e535bb57 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:38.557187 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-24599a2c-d74b-471e-82e7-ed47e535bb57 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:38.565535 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-24599a2c-d74b-471e-82e7-ed47e535bb57 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:38.567565 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-24599a2c-d74b-471e-82e7-ed47e535bb57 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:38.568752 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-24599a2c-d74b-471e-82e7-ed47e535bb57 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1752 microversion: 2.20 time: 0.155587 Aug 10 13:40:38.569329 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 218/411] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:38 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:40:38.711315 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-2d41c7ef-8218-4888-b307-f7c5c0a26a7b tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:38.711918 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-2d41c7ef-8218-4888-b307-f7c5c0a26a7b tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:38.718360 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2d41c7ef-8218-4888-b307-f7c5c0a26a7b tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:38.718849 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2d41c7ef-8218-4888-b307-f7c5c0a26a7b tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:38.719278 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2d41c7ef-8218-4888-b307-f7c5c0a26a7b tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:38.719968 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2d41c7ef-8218-4888-b307-f7c5c0a26a7b tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:38.720418 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2d41c7ef-8218-4888-b307-f7c5c0a26a7b tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:38.720837 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2d41c7ef-8218-4888-b307-f7c5c0a26a7b tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:38.850954 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-2d41c7ef-8218-4888-b307-f7c5c0a26a7b tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:38.858317 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-2d41c7ef-8218-4888-b307-f7c5c0a26a7b tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1358 microversion: 2.1 time: 0.150786 Aug 10 13:40:38.858883 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 194/412] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:38 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:39.591983 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-43f9c870-99de-48b9-af45-10617f7951a2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:39.592587 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-43f9c870-99de-48b9-af45-10617f7951a2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:39.598954 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-43f9c870-99de-48b9-af45-10617f7951a2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:39.599422 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-43f9c870-99de-48b9-af45-10617f7951a2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:39.599844 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-43f9c870-99de-48b9-af45-10617f7951a2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:39.600859 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-43f9c870-99de-48b9-af45-10617f7951a2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:39.601689 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-43f9c870-99de-48b9-af45-10617f7951a2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:39.602109 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-43f9c870-99de-48b9-af45-10617f7951a2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:39.611510 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-42ceee57-83a9-486d-b51a-8c7229553f2a req-605f9d93-2d3d-4218-b88f-4d40ea35f88b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdba9a34-3f3e-4314-a377-e6dc259c27cb", "name": "network-vif-unplugged", "status": "completed", "tag": "3fd93ef8-553f-4b67-8470-c80fc47f7c94"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:40:39.621515 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-42ceee57-83a9-486d-b51a-8c7229553f2a req-605f9d93-2d3d-4218-b88f-4d40ea35f88b service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:39.621988 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-42ceee57-83a9-486d-b51a-8c7229553f2a req-605f9d93-2d3d-4218-b88f-4d40ea35f88b service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:39.622410 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-42ceee57-83a9-486d-b51a-8c7229553f2a req-605f9d93-2d3d-4218-b88f-4d40ea35f88b service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:39.634544 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.compute.server_external_events [req-42ceee57-83a9-486d-b51a-8c7229553f2a req-605f9d93-2d3d-4218-b88f-4d40ea35f88b service nova] Unable to find a host for instance cdba9a34-3f3e-4314-a377-e6dc259c27cb. Dropping event network-vif-unplugged {{(pid=129523) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 10 13:40:39.635592 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-42ceee57-83a9-486d-b51a-8c7229553f2a req-605f9d93-2d3d-4218-b88f-4d40ea35f88b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027813 Aug 10 13:40:39.636304 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 195/413] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 10 13:40:39.735479 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-43f9c870-99de-48b9-af45-10617f7951a2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:39.744073 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-43f9c870-99de-48b9-af45-10617f7951a2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:39.745559 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-43f9c870-99de-48b9-af45-10617f7951a2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:39.746698 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-43f9c870-99de-48b9-af45-10617f7951a2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1754 microversion: 2.20 time: 0.158715 Aug 10 13:40:39.747254 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 219/414] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:39 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:40:39.879897 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-bbefab0c-8edb-4922-9470-5e3f6bf7ed14 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:39.881605 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-bbefab0c-8edb-4922-9470-5e3f6bf7ed14 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:39.889525 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bbefab0c-8edb-4922-9470-5e3f6bf7ed14 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:39.890017 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bbefab0c-8edb-4922-9470-5e3f6bf7ed14 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:39.890459 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bbefab0c-8edb-4922-9470-5e3f6bf7ed14 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:39.891330 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bbefab0c-8edb-4922-9470-5e3f6bf7ed14 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:39.891794 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bbefab0c-8edb-4922-9470-5e3f6bf7ed14 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:39.892223 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bbefab0c-8edb-4922-9470-5e3f6bf7ed14 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:40.026606 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-bbefab0c-8edb-4922-9470-5e3f6bf7ed14 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:40.034226 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-bbefab0c-8edb-4922-9470-5e3f6bf7ed14 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1548 microversion: 2.1 time: 0.159103 Aug 10 13:40:40.035327 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 196/415] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:39 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:40:40.055526 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-48ad2782-53c3-4798-bb17-6b15f4c313d7 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:40.056132 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-48ad2782-53c3-4798-bb17-6b15f4c313d7 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:40.063108 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-48ad2782-53c3-4798-bb17-6b15f4c313d7 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:40.063514 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-48ad2782-53c3-4798-bb17-6b15f4c313d7 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:40.063949 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-48ad2782-53c3-4798-bb17-6b15f4c313d7 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:40.064630 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-48ad2782-53c3-4798-bb17-6b15f4c313d7 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:40.065073 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-48ad2782-53c3-4798-bb17-6b15f4c313d7 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:40.065542 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-48ad2782-53c3-4798-bb17-6b15f4c313d7 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:40.196280 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-48ad2782-53c3-4798-bb17-6b15f4c313d7 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:40.204013 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-48ad2782-53c3-4798-bb17-6b15f4c313d7 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1548 microversion: 2.1 time: 0.152304 Aug 10 13:40:40.204579 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 220/416] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:40 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:40.224612 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-25c1c89e-d795-4cb9-a12b-faebd8c8dbb4 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:40.229510 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-25c1c89e-d795-4cb9-a12b-faebd8c8dbb4 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:40.230390 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-25c1c89e-d795-4cb9-a12b-faebd8c8dbb4 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Searching by: {'deleted': False, 'project_id': '2158cd74bdb44c47a905e34e97c5807f'} {{(pid=129523) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 13:40:40.237391 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-25c1c89e-d795-4cb9-a12b-faebd8c8dbb4 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:40.238379 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-25c1c89e-d795-4cb9-a12b-faebd8c8dbb4 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:40.238812 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-25c1c89e-d795-4cb9-a12b-faebd8c8dbb4 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:40.239563 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-25c1c89e-d795-4cb9-a12b-faebd8c8dbb4 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:40.240019 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-25c1c89e-d795-4cb9-a12b-faebd8c8dbb4 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:40.240444 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-25c1c89e-d795-4cb9-a12b-faebd8c8dbb4 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:40.334030 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.multi_cell_list [None req-25c1c89e-d795-4cb9-a12b-faebd8c8dbb4 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129523) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 13:40:40.427805 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-25c1c89e-d795-4cb9-a12b-faebd8c8dbb4 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.207062 Aug 10 13:40:40.428419 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 197/417] 10.222.0.52 () {58 vars in 1125 bytes} [Wed Aug 10 13:40:40 2022] GET /compute/v2.1/servers => generated 342 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:40:40.439912 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-0a9a08d9-2f72-423b-b8e8-237ac27f1077 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:40.440525 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-0a9a08d9-2f72-423b-b8e8-237ac27f1077 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:40.446625 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0a9a08d9-2f72-423b-b8e8-237ac27f1077 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:40.447117 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0a9a08d9-2f72-423b-b8e8-237ac27f1077 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:40.447549 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0a9a08d9-2f72-423b-b8e8-237ac27f1077 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:40.448260 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0a9a08d9-2f72-423b-b8e8-237ac27f1077 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:40.448786 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0a9a08d9-2f72-423b-b8e8-237ac27f1077 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:40.449218 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0a9a08d9-2f72-423b-b8e8-237ac27f1077 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:40.590356 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-0a9a08d9-2f72-423b-b8e8-237ac27f1077 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:40.598749 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-0a9a08d9-2f72-423b-b8e8-237ac27f1077 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1548 microversion: 2.1 time: 0.162751 Aug 10 13:40:40.599404 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 221/418] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:40:40 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1548 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:40:40.773123 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-26dfef40-b309-49d9-a7da-1578f884407f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:40.773894 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-26dfef40-b309-49d9-a7da-1578f884407f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:40.782255 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-26dfef40-b309-49d9-a7da-1578f884407f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:40.783196 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-26dfef40-b309-49d9-a7da-1578f884407f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:40.783840 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-26dfef40-b309-49d9-a7da-1578f884407f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:40.784816 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-26dfef40-b309-49d9-a7da-1578f884407f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:40.785531 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-26dfef40-b309-49d9-a7da-1578f884407f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:40.786302 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-26dfef40-b309-49d9-a7da-1578f884407f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:41.039045 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-26dfef40-b309-49d9-a7da-1578f884407f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:41.047462 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-26dfef40-b309-49d9-a7da-1578f884407f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:41.048985 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-26dfef40-b309-49d9-a7da-1578f884407f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:41.050210 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-26dfef40-b309-49d9-a7da-1578f884407f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1810 microversion: 2.20 time: 0.283301 Aug 10 13:40:41.050757 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 198/419] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:40 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1810 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:40:42.072229 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-040f068c-1632-4f22-8f30-80da1bf1f543 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:42.072876 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-040f068c-1632-4f22-8f30-80da1bf1f543 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:42.080250 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-040f068c-1632-4f22-8f30-80da1bf1f543 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:42.080726 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-040f068c-1632-4f22-8f30-80da1bf1f543 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:42.081151 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-040f068c-1632-4f22-8f30-80da1bf1f543 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:42.082376 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-040f068c-1632-4f22-8f30-80da1bf1f543 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:42.084429 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-040f068c-1632-4f22-8f30-80da1bf1f543 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:42.084879 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-040f068c-1632-4f22-8f30-80da1bf1f543 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:42.163584 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-df69622d-7c33-4293-bca5-360e9bcdf7b0 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3e83afa-5774-499c-b774-0175115d8db1"}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:40:42.166029 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-df69622d-7c33-4293-bca5-360e9bcdf7b0 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:42.172531 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-df69622d-7c33-4293-bca5-360e9bcdf7b0 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:42.173024 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-df69622d-7c33-4293-bca5-360e9bcdf7b0 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:42.173493 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-df69622d-7c33-4293-bca5-360e9bcdf7b0 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:42.174220 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-df69622d-7c33-4293-bca5-360e9bcdf7b0 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:42.174679 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-df69622d-7c33-4293-bca5-360e9bcdf7b0 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:42.175109 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-df69622d-7c33-4293-bca5-360e9bcdf7b0 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:42.218503 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-040f068c-1632-4f22-8f30-80da1bf1f543 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:42.237155 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-040f068c-1632-4f22-8f30-80da1bf1f543 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:42.240415 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-040f068c-1632-4f22-8f30-80da1bf1f543 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:42.242062 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-040f068c-1632-4f22-8f30-80da1bf1f543 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1810 microversion: 2.20 time: 0.173686 Aug 10 13:40:42.243128 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 222/420] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:42 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1810 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:40:42.429863 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-df69622d-7c33-4293-bca5-360e9bcdf7b0 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "POST /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270000 Aug 10 13:40:42.435617 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 199/421] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 10 13:40:42 2022] POST /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:40:43.265445 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-71e51c49-88e9-4f7a-b8be-ae8715ed741d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:43.265993 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-71e51c49-88e9-4f7a-b8be-ae8715ed741d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:43.273141 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-71e51c49-88e9-4f7a-b8be-ae8715ed741d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:43.273659 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-71e51c49-88e9-4f7a-b8be-ae8715ed741d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:43.274372 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-71e51c49-88e9-4f7a-b8be-ae8715ed741d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:43.275294 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-71e51c49-88e9-4f7a-b8be-ae8715ed741d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:43.275969 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-71e51c49-88e9-4f7a-b8be-ae8715ed741d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:43.276548 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-71e51c49-88e9-4f7a-b8be-ae8715ed741d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:43.414071 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-71e51c49-88e9-4f7a-b8be-ae8715ed741d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:43.422685 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-71e51c49-88e9-4f7a-b8be-ae8715ed741d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:43.424171 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-71e51c49-88e9-4f7a-b8be-ae8715ed741d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:43.425396 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-71e51c49-88e9-4f7a-b8be-ae8715ed741d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1810 microversion: 2.20 time: 0.163956 Aug 10 13:40:43.425948 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 223/422] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:43 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:40:44.450068 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-e1f7750e-09ff-4e5a-8cf6-0f8c642b1698 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:44.451794 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-e1f7750e-09ff-4e5a-8cf6-0f8c642b1698 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:44.459998 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:40:44.462370 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e1f7750e-09ff-4e5a-8cf6-0f8c642b1698 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:44.463177 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e1f7750e-09ff-4e5a-8cf6-0f8c642b1698 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:44.463744 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e1f7750e-09ff-4e5a-8cf6-0f8c642b1698 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:44.464620 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e1f7750e-09ff-4e5a-8cf6-0f8c642b1698 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:44.465131 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e1f7750e-09ff-4e5a-8cf6-0f8c642b1698 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:44.465641 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e1f7750e-09ff-4e5a-8cf6-0f8c642b1698 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:44.603399 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-e1f7750e-09ff-4e5a-8cf6-0f8c642b1698 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:44.611993 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-e1f7750e-09ff-4e5a-8cf6-0f8c642b1698 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:44.613833 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-e1f7750e-09ff-4e5a-8cf6-0f8c642b1698 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:44.615005 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-e1f7750e-09ff-4e5a-8cf6-0f8c642b1698 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1810 microversion: 2.20 time: 0.169748 Aug 10 13:40:44.615587 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 200/423] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:44 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:40:45.643192 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-5588b324-1e00-4bfb-9cd3-b289795915d7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:45.644328 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-5588b324-1e00-4bfb-9cd3-b289795915d7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:45.651107 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5588b324-1e00-4bfb-9cd3-b289795915d7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:45.651595 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5588b324-1e00-4bfb-9cd3-b289795915d7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:45.652113 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5588b324-1e00-4bfb-9cd3-b289795915d7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:45.652701 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5588b324-1e00-4bfb-9cd3-b289795915d7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:45.653132 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5588b324-1e00-4bfb-9cd3-b289795915d7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:45.653568 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5588b324-1e00-4bfb-9cd3-b289795915d7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:45.792849 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-5588b324-1e00-4bfb-9cd3-b289795915d7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:45.801358 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-5588b324-1e00-4bfb-9cd3-b289795915d7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:45.802857 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-5588b324-1e00-4bfb-9cd3-b289795915d7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:45.804258 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-5588b324-1e00-4bfb-9cd3-b289795915d7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1810 microversion: 2.20 time: 0.165773 Aug 10 13:40:45.804810 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 224/424] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:45 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:40:46.827593 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-f865357f-18c3-432d-b5cd-d898577a272d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:46.828218 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-f865357f-18c3-432d-b5cd-d898577a272d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:46.836462 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f865357f-18c3-432d-b5cd-d898577a272d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:46.837003 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f865357f-18c3-432d-b5cd-d898577a272d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:46.837468 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f865357f-18c3-432d-b5cd-d898577a272d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:46.838170 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f865357f-18c3-432d-b5cd-d898577a272d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:46.838775 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f865357f-18c3-432d-b5cd-d898577a272d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:46.839210 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f865357f-18c3-432d-b5cd-d898577a272d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:47.001750 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-f865357f-18c3-432d-b5cd-d898577a272d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:47.010381 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-f865357f-18c3-432d-b5cd-d898577a272d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:47.011871 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-f865357f-18c3-432d-b5cd-d898577a272d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:47.013031 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-f865357f-18c3-432d-b5cd-d898577a272d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1810 microversion: 2.20 time: 0.189315 Aug 10 13:40:47.013836 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 201/425] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:46 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1810 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:40:48.040076 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-b22ed517-19e7-4677-852f-7b9ff91ec1b2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:48.041027 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-b22ed517-19e7-4677-852f-7b9ff91ec1b2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:48.050888 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b22ed517-19e7-4677-852f-7b9ff91ec1b2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:48.051624 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b22ed517-19e7-4677-852f-7b9ff91ec1b2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:48.052277 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b22ed517-19e7-4677-852f-7b9ff91ec1b2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:48.053354 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b22ed517-19e7-4677-852f-7b9ff91ec1b2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:48.054057 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b22ed517-19e7-4677-852f-7b9ff91ec1b2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:48.054695 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b22ed517-19e7-4677-852f-7b9ff91ec1b2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:48.201981 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-b22ed517-19e7-4677-852f-7b9ff91ec1b2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:48.211282 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-b22ed517-19e7-4677-852f-7b9ff91ec1b2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:48.212821 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-b22ed517-19e7-4677-852f-7b9ff91ec1b2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:48.214047 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-b22ed517-19e7-4677-852f-7b9ff91ec1b2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1810 microversion: 2.20 time: 0.181059 Aug 10 13:40:48.214610 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 225/426] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:48 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1810 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:40:49.239778 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-9f2de94b-ac21-4375-a36d-88adab05b7fe tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:49.240410 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-9f2de94b-ac21-4375-a36d-88adab05b7fe tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:49.255513 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9f2de94b-ac21-4375-a36d-88adab05b7fe tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:49.256008 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9f2de94b-ac21-4375-a36d-88adab05b7fe tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:49.256438 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9f2de94b-ac21-4375-a36d-88adab05b7fe tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:49.257168 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9f2de94b-ac21-4375-a36d-88adab05b7fe tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:49.257646 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9f2de94b-ac21-4375-a36d-88adab05b7fe tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:49.258063 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9f2de94b-ac21-4375-a36d-88adab05b7fe tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:49.398050 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-9f2de94b-ac21-4375-a36d-88adab05b7fe tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:49.406796 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-9f2de94b-ac21-4375-a36d-88adab05b7fe tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:49.408279 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-9f2de94b-ac21-4375-a36d-88adab05b7fe tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:49.409521 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-9f2de94b-ac21-4375-a36d-88adab05b7fe tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1810 microversion: 2.20 time: 0.174437 Aug 10 13:40:49.410272 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 202/427] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:49 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:40:50.432041 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-d45d8e20-054a-4af1-82c1-d6b3cf989dc0 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:50.432632 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-d45d8e20-054a-4af1-82c1-d6b3cf989dc0 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:50.438968 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d45d8e20-054a-4af1-82c1-d6b3cf989dc0 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:50.439445 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d45d8e20-054a-4af1-82c1-d6b3cf989dc0 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:50.439928 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d45d8e20-054a-4af1-82c1-d6b3cf989dc0 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:50.441108 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d45d8e20-054a-4af1-82c1-d6b3cf989dc0 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:50.441782 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d45d8e20-054a-4af1-82c1-d6b3cf989dc0 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:50.442384 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d45d8e20-054a-4af1-82c1-d6b3cf989dc0 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:50.458991 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:40:50.591354 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-d45d8e20-054a-4af1-82c1-d6b3cf989dc0 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:50.600762 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-d45d8e20-054a-4af1-82c1-d6b3cf989dc0 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:50.602377 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-d45d8e20-054a-4af1-82c1-d6b3cf989dc0 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:50.603567 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-d45d8e20-054a-4af1-82c1-d6b3cf989dc0 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1810 microversion: 2.20 time: 0.175378 Aug 10 13:40:50.604124 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 226/428] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:50 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:40:51.623979 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell0:SELECT=2 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:40:51.630395 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-89e1aa06-9e3f-4131-9ac9-eaead753f5cb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:51.631096 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-89e1aa06-9e3f-4131-9ac9-eaead753f5cb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:51.637973 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-89e1aa06-9e3f-4131-9ac9-eaead753f5cb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:51.638565 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-89e1aa06-9e3f-4131-9ac9-eaead753f5cb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:51.639318 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-89e1aa06-9e3f-4131-9ac9-eaead753f5cb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:51.640393 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-89e1aa06-9e3f-4131-9ac9-eaead753f5cb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:51.640917 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-89e1aa06-9e3f-4131-9ac9-eaead753f5cb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:51.641512 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-89e1aa06-9e3f-4131-9ac9-eaead753f5cb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:51.779920 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-89e1aa06-9e3f-4131-9ac9-eaead753f5cb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:51.788957 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-89e1aa06-9e3f-4131-9ac9-eaead753f5cb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:51.790473 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-89e1aa06-9e3f-4131-9ac9-eaead753f5cb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:51.791675 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-89e1aa06-9e3f-4131-9ac9-eaead753f5cb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1810 microversion: 2.20 time: 0.168978 Aug 10 13:40:51.792222 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 203/429] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:51 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:40:52.816557 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-ab93d688-0c59-4747-a194-63a0726cd8cf tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:52.817171 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-ab93d688-0c59-4747-a194-63a0726cd8cf tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:52.823692 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ab93d688-0c59-4747-a194-63a0726cd8cf tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:52.824169 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ab93d688-0c59-4747-a194-63a0726cd8cf tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:52.824602 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ab93d688-0c59-4747-a194-63a0726cd8cf tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:52.825338 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ab93d688-0c59-4747-a194-63a0726cd8cf tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:52.825793 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ab93d688-0c59-4747-a194-63a0726cd8cf tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:52.826216 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ab93d688-0c59-4747-a194-63a0726cd8cf tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:52.962455 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-ab93d688-0c59-4747-a194-63a0726cd8cf tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:52.971064 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-ab93d688-0c59-4747-a194-63a0726cd8cf tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:52.972504 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-ab93d688-0c59-4747-a194-63a0726cd8cf tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:52.973694 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-ab93d688-0c59-4747-a194-63a0726cd8cf tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1810 microversion: 2.20 time: 0.161555 Aug 10 13:40:52.974254 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 227/430] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:52 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:40:53.997130 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-e8cda177-6210-4513-883e-ec2b5b768163 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:53.997762 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-e8cda177-6210-4513-883e-ec2b5b768163 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:54.004659 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e8cda177-6210-4513-883e-ec2b5b768163 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:54.005138 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e8cda177-6210-4513-883e-ec2b5b768163 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:54.005601 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e8cda177-6210-4513-883e-ec2b5b768163 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:54.006284 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e8cda177-6210-4513-883e-ec2b5b768163 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:54.006741 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e8cda177-6210-4513-883e-ec2b5b768163 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:54.007164 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e8cda177-6210-4513-883e-ec2b5b768163 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:54.136713 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-e8cda177-6210-4513-883e-ec2b5b768163 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:54.145176 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-e8cda177-6210-4513-883e-ec2b5b768163 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:54.146749 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-e8cda177-6210-4513-883e-ec2b5b768163 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:54.147888 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-e8cda177-6210-4513-883e-ec2b5b768163 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1810 microversion: 2.20 time: 0.154651 Aug 10 13:40:54.148427 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 204/431] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:53 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:40:55.170776 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-a5a8f342-5b1e-4375-b82c-4518fb916b88 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:55.171378 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-a5a8f342-5b1e-4375-b82c-4518fb916b88 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:55.178187 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a5a8f342-5b1e-4375-b82c-4518fb916b88 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:55.178658 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a5a8f342-5b1e-4375-b82c-4518fb916b88 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:55.179084 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a5a8f342-5b1e-4375-b82c-4518fb916b88 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:55.179792 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a5a8f342-5b1e-4375-b82c-4518fb916b88 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:55.180553 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a5a8f342-5b1e-4375-b82c-4518fb916b88 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:55.180682 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a5a8f342-5b1e-4375-b82c-4518fb916b88 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:55.307400 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-a5a8f342-5b1e-4375-b82c-4518fb916b88 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:55.316336 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-a5a8f342-5b1e-4375-b82c-4518fb916b88 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:55.317863 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-a5a8f342-5b1e-4375-b82c-4518fb916b88 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:55.319017 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-a5a8f342-5b1e-4375-b82c-4518fb916b88 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1810 microversion: 2.20 time: 0.152390 Aug 10 13:40:55.319563 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 228/432] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:55 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:40:56.342026 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-2ed50716-f98c-4764-b36b-63167f6b600d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:56.342630 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-2ed50716-f98c-4764-b36b-63167f6b600d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:56.348979 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2ed50716-f98c-4764-b36b-63167f6b600d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:56.349485 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2ed50716-f98c-4764-b36b-63167f6b600d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:56.349917 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2ed50716-f98c-4764-b36b-63167f6b600d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:56.350596 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2ed50716-f98c-4764-b36b-63167f6b600d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:56.351046 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2ed50716-f98c-4764-b36b-63167f6b600d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:56.351463 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2ed50716-f98c-4764-b36b-63167f6b600d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:56.479818 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-2ed50716-f98c-4764-b36b-63167f6b600d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:56.488409 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-2ed50716-f98c-4764-b36b-63167f6b600d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:56.489956 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-2ed50716-f98c-4764-b36b-63167f6b600d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:56.491094 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-2ed50716-f98c-4764-b36b-63167f6b600d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1810 microversion: 2.20 time: 0.152973 Aug 10 13:40:56.491645 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 205/433] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:56 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:40:57.514692 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-c90aa203-4846-4305-a088-71bf73a91dac tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:57.515333 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-c90aa203-4846-4305-a088-71bf73a91dac tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:57.522690 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c90aa203-4846-4305-a088-71bf73a91dac tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:57.523177 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c90aa203-4846-4305-a088-71bf73a91dac tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:57.523619 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c90aa203-4846-4305-a088-71bf73a91dac tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:57.524302 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c90aa203-4846-4305-a088-71bf73a91dac tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:57.524803 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c90aa203-4846-4305-a088-71bf73a91dac tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:57.525176 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c90aa203-4846-4305-a088-71bf73a91dac tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:57.649338 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-c90aa203-4846-4305-a088-71bf73a91dac tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:57.657624 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-c90aa203-4846-4305-a088-71bf73a91dac tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:57.659725 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-c90aa203-4846-4305-a088-71bf73a91dac tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:57.660884 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-c90aa203-4846-4305-a088-71bf73a91dac tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1810 microversion: 2.20 time: 0.150120 Aug 10 13:40:57.661480 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 229/434] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:57 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1810 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:40:58.683306 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-552eb837-5d62-41d8-ad2a-bac6a46580f0 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:58.683913 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-552eb837-5d62-41d8-ad2a-bac6a46580f0 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:58.690812 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-552eb837-5d62-41d8-ad2a-bac6a46580f0 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:58.691288 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-552eb837-5d62-41d8-ad2a-bac6a46580f0 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:58.691719 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-552eb837-5d62-41d8-ad2a-bac6a46580f0 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:58.692399 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-552eb837-5d62-41d8-ad2a-bac6a46580f0 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:58.692848 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-552eb837-5d62-41d8-ad2a-bac6a46580f0 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:58.693294 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-552eb837-5d62-41d8-ad2a-bac6a46580f0 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:58.711209 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:40:58.829049 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-552eb837-5d62-41d8-ad2a-bac6a46580f0 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:58.837370 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-552eb837-5d62-41d8-ad2a-bac6a46580f0 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:58.838868 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-552eb837-5d62-41d8-ad2a-bac6a46580f0 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:40:58.840015 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-552eb837-5d62-41d8-ad2a-bac6a46580f0 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1810 microversion: 2.20 time: 0.160610 Aug 10 13:40:58.840572 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 206/435] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:58 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:40:59.865130 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-d5dfed00-c80d-4016-9072-94353195908f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:40:59.867338 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-d5dfed00-c80d-4016-9072-94353195908f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:40:59.872078 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d5dfed00-c80d-4016-9072-94353195908f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:59.872587 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d5dfed00-c80d-4016-9072-94353195908f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:59.873016 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d5dfed00-c80d-4016-9072-94353195908f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:59.873748 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d5dfed00-c80d-4016-9072-94353195908f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:40:59.874199 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d5dfed00-c80d-4016-9072-94353195908f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:40:59.874618 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d5dfed00-c80d-4016-9072-94353195908f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:40:59.943545 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:40:59.943800 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Wed Aug 10 13:40:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb (ip 10.222.0.52) !!! Aug 10 13:41:00.020928 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-d5dfed00-c80d-4016-9072-94353195908f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:00.029172 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-d5dfed00-c80d-4016-9072-94353195908f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:00.030691 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-d5dfed00-c80d-4016-9072-94353195908f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:00.031849 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-d5dfed00-c80d-4016-9072-94353195908f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1810 microversion: 2.20 time: 0.172103 Aug 10 13:41:00.032409 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 230/436] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:40:59 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:41:00.615712 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-000c9b9f-c76a-45c6-ba96-627ec6789090 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:00.616390 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-000c9b9f-c76a-45c6-ba96-627ec6789090 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:00.622775 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-000c9b9f-c76a-45c6-ba96-627ec6789090 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:00.623260 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-000c9b9f-c76a-45c6-ba96-627ec6789090 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:00.623696 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-000c9b9f-c76a-45c6-ba96-627ec6789090 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:00.624382 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-000c9b9f-c76a-45c6-ba96-627ec6789090 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:00.624837 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-000c9b9f-c76a-45c6-ba96-627ec6789090 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:00.625291 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-000c9b9f-c76a-45c6-ba96-627ec6789090 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:00.749732 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-000c9b9f-c76a-45c6-ba96-627ec6789090 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:00.759019 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-000c9b9f-c76a-45c6-ba96-627ec6789090 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1594 microversion: 2.1 time: 0.147397 Aug 10 13:41:00.759590 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 207/437] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:00 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1594 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:01.055435 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-b5dd716a-e728-4914-a3fb-487b654cf05e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:01.056043 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-b5dd716a-e728-4914-a3fb-487b654cf05e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:01.062531 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b5dd716a-e728-4914-a3fb-487b654cf05e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:01.063012 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b5dd716a-e728-4914-a3fb-487b654cf05e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:01.063443 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b5dd716a-e728-4914-a3fb-487b654cf05e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:01.064130 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b5dd716a-e728-4914-a3fb-487b654cf05e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:01.064605 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b5dd716a-e728-4914-a3fb-487b654cf05e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:01.065024 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b5dd716a-e728-4914-a3fb-487b654cf05e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:01.279105 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-b5dd716a-e728-4914-a3fb-487b654cf05e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:01.287463 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-b5dd716a-e728-4914-a3fb-487b654cf05e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:01.288989 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-b5dd716a-e728-4914-a3fb-487b654cf05e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:01.290168 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-b5dd716a-e728-4914-a3fb-487b654cf05e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1810 microversion: 2.20 time: 0.238632 Aug 10 13:41:01.290724 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 231/438] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:41:01 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1810 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:41:02.313116 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-030a1efc-89d3-4356-ae63-7f276ad84677 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:02.314027 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-030a1efc-89d3-4356-ae63-7f276ad84677 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:02.321016 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-030a1efc-89d3-4356-ae63-7f276ad84677 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:02.321530 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-030a1efc-89d3-4356-ae63-7f276ad84677 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:02.321968 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-030a1efc-89d3-4356-ae63-7f276ad84677 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:02.322664 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-030a1efc-89d3-4356-ae63-7f276ad84677 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:02.323116 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-030a1efc-89d3-4356-ae63-7f276ad84677 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:02.323537 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-030a1efc-89d3-4356-ae63-7f276ad84677 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:02.459797 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-030a1efc-89d3-4356-ae63-7f276ad84677 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:02.468879 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-030a1efc-89d3-4356-ae63-7f276ad84677 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:02.470404 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-030a1efc-89d3-4356-ae63-7f276ad84677 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:02.471614 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-030a1efc-89d3-4356-ae63-7f276ad84677 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1810 microversion: 2.20 time: 0.162430 Aug 10 13:41:02.472169 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 208/439] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:41:02 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:41:02.711611 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-47465d92-21b9-410e-af39-3457a46cd141 req-17f0d88f-a4e9-417d-8188-0e08d4f19c67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45a8ce5d-0dc9-426c-bf2d-d81a99e26e39", "tag": "18644036-6089-4e3d-9098-4284e0ee683c"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:41:02.722660 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-47465d92-21b9-410e-af39-3457a46cd141 req-17f0d88f-a4e9-417d-8188-0e08d4f19c67 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:02.723476 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-47465d92-21b9-410e-af39-3457a46cd141 req-17f0d88f-a4e9-417d-8188-0e08d4f19c67 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:02.724347 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-47465d92-21b9-410e-af39-3457a46cd141 req-17f0d88f-a4e9-417d-8188-0e08d4f19c67 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:02.738560 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-47465d92-21b9-410e-af39-3457a46cd141 req-17f0d88f-a4e9-417d-8188-0e08d4f19c67 service nova] Creating event network-changed:18644036-6089-4e3d-9098-4284e0ee683c for instance 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 on hv-cinder-85200 Aug 10 13:41:02.744113 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-47465d92-21b9-410e-af39-3457a46cd141 req-17f0d88f-a4e9-417d-8188-0e08d4f19c67 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036284 Aug 10 13:41:02.744986 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 232/440] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:41:03.494896 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-91f12665-9a25-4ecc-aa64-5d057626b8e8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:03.495699 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-91f12665-9a25-4ecc-aa64-5d057626b8e8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:03.510250 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-91f12665-9a25-4ecc-aa64-5d057626b8e8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:03.510750 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-91f12665-9a25-4ecc-aa64-5d057626b8e8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:03.511190 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-91f12665-9a25-4ecc-aa64-5d057626b8e8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:03.511910 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-91f12665-9a25-4ecc-aa64-5d057626b8e8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:03.512360 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-91f12665-9a25-4ecc-aa64-5d057626b8e8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:03.512787 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-91f12665-9a25-4ecc-aa64-5d057626b8e8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:03.782196 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-91f12665-9a25-4ecc-aa64-5d057626b8e8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:03.792818 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-91f12665-9a25-4ecc-aa64-5d057626b8e8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:03.795105 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-91f12665-9a25-4ecc-aa64-5d057626b8e8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:03.803004 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-91f12665-9a25-4ecc-aa64-5d057626b8e8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1810 microversion: 2.20 time: 0.312179 Aug 10 13:41:03.820553 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 209/441] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:41:03 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1810 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:41:03.840115 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-8a23f461-f1db-488f-a42b-88cdc9dce7ed req-c6538c6c-d345-4042-909e-82dba7dde4fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdba9a34-3f3e-4314-a377-e6dc259c27cb", "name": "network-vif-plugged", "status": "completed", "tag": "3fd93ef8-553f-4b67-8470-c80fc47f7c94"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:41:03.853978 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-8a23f461-f1db-488f-a42b-88cdc9dce7ed req-c6538c6c-d345-4042-909e-82dba7dde4fd service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:03.854713 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-8a23f461-f1db-488f-a42b-88cdc9dce7ed req-c6538c6c-d345-4042-909e-82dba7dde4fd service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:03.855308 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-8a23f461-f1db-488f-a42b-88cdc9dce7ed req-c6538c6c-d345-4042-909e-82dba7dde4fd service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:03.867772 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-8a23f461-f1db-488f-a42b-88cdc9dce7ed req-c6538c6c-d345-4042-909e-82dba7dde4fd service nova] Creating event network-vif-plugged:3fd93ef8-553f-4b67-8470-c80fc47f7c94 for instance cdba9a34-3f3e-4314-a377-e6dc259c27cb on hv-cinder-85200 Aug 10 13:41:03.873258 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-8a23f461-f1db-488f-a42b-88cdc9dce7ed req-c6538c6c-d345-4042-909e-82dba7dde4fd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037147 Aug 10 13:41:03.874421 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 233/442] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:41:04.103591 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-837f1b33-3c2c-4c96-864f-e11f0f04a836 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1599425877"}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:41:04.104130 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-837f1b33-3c2c-4c96-864f-e11f0f04a836 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:04.110110 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-837f1b33-3c2c-4c96-864f-e11f0f04a836 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:04.110627 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-837f1b33-3c2c-4c96-864f-e11f0f04a836 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:04.111059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-837f1b33-3c2c-4c96-864f-e11f0f04a836 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:04.111771 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-837f1b33-3c2c-4c96-864f-e11f0f04a836 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:04.113044 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-837f1b33-3c2c-4c96-864f-e11f0f04a836 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:04.113501 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-837f1b33-3c2c-4c96-864f-e11f0f04a836 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:04.241154 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.network.security_group_api [None req-837f1b33-3c2c-4c96-864f-e11f0f04a836 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Adding security group 050af66d-bd80-4856-b129-72cbe02f8117 to port 18644036-6089-4e3d-9098-4284e0ee683c Aug 10 13:41:04.623216 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-837f1b33-3c2c-4c96-864f-e11f0f04a836 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "POST /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39/action" status: 202 len: 0 microversion: 2.1 time: 0.523492 Aug 10 13:41:04.624042 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 210/443] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 10 13:41:04 2022] POST /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39/action => generated 0 bytes in 525 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 13:41:04.637519 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-44dbd6e3-659d-4b1b-8e2d-d35ac6cedc9d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:04.638361 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-44dbd6e3-659d-4b1b-8e2d-d35ac6cedc9d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:04.641640 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-a1ea57ef-fb53-4383-a51c-2a56e35fc757 req-d192f966-7766-4e0f-bf89-344663384d30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45a8ce5d-0dc9-426c-bf2d-d81a99e26e39", "tag": "18644036-6089-4e3d-9098-4284e0ee683c"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:41:04.651734 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-44dbd6e3-659d-4b1b-8e2d-d35ac6cedc9d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:04.652369 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-44dbd6e3-659d-4b1b-8e2d-d35ac6cedc9d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:04.652929 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-44dbd6e3-659d-4b1b-8e2d-d35ac6cedc9d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:04.654721 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-44dbd6e3-659d-4b1b-8e2d-d35ac6cedc9d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:04.656219 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-44dbd6e3-659d-4b1b-8e2d-d35ac6cedc9d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:04.656219 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-44dbd6e3-659d-4b1b-8e2d-d35ac6cedc9d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:04.661058 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-a1ea57ef-fb53-4383-a51c-2a56e35fc757 req-d192f966-7766-4e0f-bf89-344663384d30 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:04.663271 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-a1ea57ef-fb53-4383-a51c-2a56e35fc757 req-d192f966-7766-4e0f-bf89-344663384d30 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:04.663721 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-a1ea57ef-fb53-4383-a51c-2a56e35fc757 req-d192f966-7766-4e0f-bf89-344663384d30 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:04.683554 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-a1ea57ef-fb53-4383-a51c-2a56e35fc757 req-d192f966-7766-4e0f-bf89-344663384d30 service nova] Creating event network-changed:18644036-6089-4e3d-9098-4284e0ee683c for instance 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 on hv-cinder-85200 Aug 10 13:41:04.688707 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-a1ea57ef-fb53-4383-a51c-2a56e35fc757 req-d192f966-7766-4e0f-bf89-344663384d30 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054635 Aug 10 13:41:04.689492 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 211/444] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:41:04.698030 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-bba2a50a-cdf6-489c-8d6e-ebb1a2963d3e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c17ef3e5-dc53-48b9-87cb-908c33ddad66"}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:41:04.700513 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-bba2a50a-cdf6-489c-8d6e-ebb1a2963d3e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:04.707801 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bba2a50a-cdf6-489c-8d6e-ebb1a2963d3e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:04.708294 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bba2a50a-cdf6-489c-8d6e-ebb1a2963d3e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:04.708752 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bba2a50a-cdf6-489c-8d6e-ebb1a2963d3e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:04.709516 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bba2a50a-cdf6-489c-8d6e-ebb1a2963d3e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:04.709980 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bba2a50a-cdf6-489c-8d6e-ebb1a2963d3e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:04.710414 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bba2a50a-cdf6-489c-8d6e-ebb1a2963d3e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:04.826790 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-44dbd6e3-659d-4b1b-8e2d-d35ac6cedc9d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:04.834873 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-44dbd6e3-659d-4b1b-8e2d-d35ac6cedc9d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1760 microversion: 2.1 time: 0.205656 Aug 10 13:41:04.835449 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 234/445] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:04 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1760 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:04.851464 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-c798b182-c5db-4bdd-b88b-68e32473e871 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:04.852556 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-c798b182-c5db-4bdd-b88b-68e32473e871 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:04.859269 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c798b182-c5db-4bdd-b88b-68e32473e871 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:04.859642 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c798b182-c5db-4bdd-b88b-68e32473e871 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:04.860090 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c798b182-c5db-4bdd-b88b-68e32473e871 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:04.860784 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c798b182-c5db-4bdd-b88b-68e32473e871 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:04.861451 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c798b182-c5db-4bdd-b88b-68e32473e871 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:04.862438 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c798b182-c5db-4bdd-b88b-68e32473e871 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:05.031465 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-c798b182-c5db-4bdd-b88b-68e32473e871 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:05.040467 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-c798b182-c5db-4bdd-b88b-68e32473e871 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:05.042182 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-c798b182-c5db-4bdd-b88b-68e32473e871 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:05.043990 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-c798b182-c5db-4bdd-b88b-68e32473e871 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1810 microversion: 2.20 time: 0.196364 Aug 10 13:41:05.045032 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 235/446] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:41:04 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1810 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:41:05.091117 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-bba2a50a-cdf6-489c-8d6e-ebb1a2963d3e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "POST /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.396899 Aug 10 13:41:05.092623 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 212/447] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 10 13:41:04 2022] POST /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131/os-volume_attachments => generated 194 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:41:06.068033 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-9d081fe3-1f5e-4284-99ef-3d4d35456b14 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:06.068561 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-9d081fe3-1f5e-4284-99ef-3d4d35456b14 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:06.075302 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9d081fe3-1f5e-4284-99ef-3d4d35456b14 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:06.075780 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9d081fe3-1f5e-4284-99ef-3d4d35456b14 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:06.076204 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9d081fe3-1f5e-4284-99ef-3d4d35456b14 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:06.076915 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9d081fe3-1f5e-4284-99ef-3d4d35456b14 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:06.077436 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9d081fe3-1f5e-4284-99ef-3d4d35456b14 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:06.077854 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9d081fe3-1f5e-4284-99ef-3d4d35456b14 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:06.218100 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-9d081fe3-1f5e-4284-99ef-3d4d35456b14 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:06.227287 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-9d081fe3-1f5e-4284-99ef-3d4d35456b14 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:06.229368 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-9d081fe3-1f5e-4284-99ef-3d4d35456b14 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:06.231571 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-9d081fe3-1f5e-4284-99ef-3d4d35456b14 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1810 microversion: 2.20 time: 0.167660 Aug 10 13:41:06.232562 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 236/448] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:41:06 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:41:07.256829 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-57ac04a8-afd6-4823-b069-d026418185d4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:07.257560 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-57ac04a8-afd6-4823-b069-d026418185d4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:07.264209 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-57ac04a8-afd6-4823-b069-d026418185d4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:07.264695 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-57ac04a8-afd6-4823-b069-d026418185d4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:07.265129 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-57ac04a8-afd6-4823-b069-d026418185d4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:07.265848 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-57ac04a8-afd6-4823-b069-d026418185d4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:07.266302 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-57ac04a8-afd6-4823-b069-d026418185d4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:07.266725 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-57ac04a8-afd6-4823-b069-d026418185d4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:07.398564 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-57ac04a8-afd6-4823-b069-d026418185d4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:07.406861 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-57ac04a8-afd6-4823-b069-d026418185d4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:07.408394 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-57ac04a8-afd6-4823-b069-d026418185d4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:07.409621 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-57ac04a8-afd6-4823-b069-d026418185d4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1810 microversion: 2.20 time: 0.157615 Aug 10 13:41:07.410174 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 213/449] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:41:07 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:41:08.433133 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-ad13a07a-da28-4c48-9961-a9e350fcb441 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:08.433763 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-ad13a07a-da28-4c48-9961-a9e350fcb441 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:08.436512 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_api:SELECT=44 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:41:08.442125 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ad13a07a-da28-4c48-9961-a9e350fcb441 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:08.442611 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ad13a07a-da28-4c48-9961-a9e350fcb441 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:08.443046 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ad13a07a-da28-4c48-9961-a9e350fcb441 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:08.443759 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ad13a07a-da28-4c48-9961-a9e350fcb441 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:08.444235 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ad13a07a-da28-4c48-9961-a9e350fcb441 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:08.444652 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ad13a07a-da28-4c48-9961-a9e350fcb441 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:08.572257 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-ad13a07a-da28-4c48-9961-a9e350fcb441 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:08.581454 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-ad13a07a-da28-4c48-9961-a9e350fcb441 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:08.582987 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-ad13a07a-da28-4c48-9961-a9e350fcb441 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:08.584182 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-ad13a07a-da28-4c48-9961-a9e350fcb441 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1810 microversion: 2.20 time: 0.154871 Aug 10 13:41:08.584796 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 237/450] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:41:08 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:41:09.152988 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-bdd3ebd2-2c47-4aef-8e82-8892ebfdc847 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:09.153544 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-bdd3ebd2-2c47-4aef-8e82-8892ebfdc847 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 0d6055de-aea1-4e3b-9016-4c25dca9f779] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:09.159990 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bdd3ebd2-2c47-4aef-8e82-8892ebfdc847 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:09.160473 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bdd3ebd2-2c47-4aef-8e82-8892ebfdc847 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:09.160903 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bdd3ebd2-2c47-4aef-8e82-8892ebfdc847 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:09.161600 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bdd3ebd2-2c47-4aef-8e82-8892ebfdc847 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:09.162050 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bdd3ebd2-2c47-4aef-8e82-8892ebfdc847 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:09.162465 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bdd3ebd2-2c47-4aef-8e82-8892ebfdc847 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:09.184303 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-bdd3ebd2-2c47-4aef-8e82-8892ebfdc847 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779/ips" status: 200 len: 150 microversion: 2.1 time: 0.035180 Aug 10 13:41:09.184851 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 214/451] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Aug 10 13:41:09 2022] GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779/ips => generated 150 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:41:09.198096 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-e7ff958e-900d-466b-b53a-98cfa99497a5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df1b6cd6-7430-4566-87b8-0476af2cea6a"}} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:41:09.200596 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-e7ff958e-900d-466b-b53a-98cfa99497a5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 0d6055de-aea1-4e3b-9016-4c25dca9f779] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:09.207392 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e7ff958e-900d-466b-b53a-98cfa99497a5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:09.207903 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e7ff958e-900d-466b-b53a-98cfa99497a5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:09.208376 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e7ff958e-900d-466b-b53a-98cfa99497a5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:09.209141 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e7ff958e-900d-466b-b53a-98cfa99497a5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:09.209669 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e7ff958e-900d-466b-b53a-98cfa99497a5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:09.210140 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e7ff958e-900d-466b-b53a-98cfa99497a5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:09.295728 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.wsgi [None req-e7ff958e-900d-466b-b53a-98cfa99497a5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] HTTP exception thrown: Invalid volume: volume df1b6cd6-7430-4566-87b8-0476af2cea6a is already attached to instances: 41baab24-f648-4e7d-83bb-4357214ea438 Aug 10 13:41:09.297563 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-e7ff958e-900d-466b-b53a-98cfa99497a5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Request method failure captured: Aug 10 13:41:09.297563 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: request: POST /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779/os-volume_attachments HTTP/1.1 Aug 10 13:41:09.297563 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept: application/json Aug 10 13:41:09.297563 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept-Encoding: identity Aug 10 13:41:09.297563 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Connection: close Aug 10 13:41:09.297563 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Length: 74 Aug 10 13:41:09.297563 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Type: application/json Aug 10 13:41:09.297563 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Host: 10.222.0.52 Aug 10 13:41:09.297563 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Openstack-System-Scope: None Aug 10 13:41:09.297563 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: User-Agent: python-urllib3/1.26.11 Aug 10 13:41:09.297563 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Auth-Token: gAAAAABi87Sor1QukN8WwkCMRH0utTzHqdtW9hBypcULvW8_thEN8NIRbRb3dRFY62pVCieUmq7t4p3U1aqc6NH3mLhkTq5eSrbHxF5HfdCRrvoVeQ0o3DpawgBQQZEUeD2RccyRTg2LrZLPb9H0A6tO9wPr-HvRM84fUPq4D0GzK22Ap72p14g Aug 10 13:41:09.297563 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Id: None Aug 10 13:41:09.297563 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Name: None Aug 10 13:41:09.297563 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Identity-Status: Confirmed Aug 10 13:41:09.297563 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Is-Admin-Project: True Aug 10 13:41:09.297563 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Id: default Aug 10 13:41:09.297563 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Name: Default Aug 10 13:41:09.297563 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Id: 48e5556cbbfd4b00aa4f6055cd6238b2 Aug 10 13:41:09.297563 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Name: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:41:09.297563 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Role: member,reader Aug 10 13:41:09.297563 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Roles: member,reader Aug 10 13:41:09.299823 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/48e5556cbbfd4b00aa4f6055cd6238b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48e5556cbbfd4b00aa4f6055cd6238b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_48e5556cbbfd4b00aa4f6055cd6238b2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48e5556cbbfd4b00aa4f6055cd6238b2"}]}] Aug 10 13:41:09.299823 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:41:09.299823 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Id: 48e5556cbbfd4b00aa4f6055cd6238b2 Aug 10 13:41:09.299823 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:41:09.299823 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User: tempest-AttachVolumeNegativeTest-965925392-project Aug 10 13:41:09.299823 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Id: default Aug 10 13:41:09.299823 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Name: Default Aug 10 13:41:09.299823 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Id: a3d9e5dc719c430eac6b5c8d8b814566 Aug 10 13:41:09.299823 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Name: tempest-AttachVolumeNegativeTest-965925392-project Aug 10 13:41:09.299823 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Aug 10 13:41:09.299823 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: {"volumeAttachment": {"volumeId": "df1b6cd6-7430-4566-87b8-0476af2cea6a"}} Aug 10 13:41:09.299823 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: method: > Aug 10 13:41:09.300586 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: exception: Invalid volume: volume df1b6cd6-7430-4566-87b8-0476af2cea6a is already attached to instances: 41baab24-f648-4e7d-83bb-4357214ea438 Aug 10 13:41:09.300586 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: action_args: {'server_id': '0d6055de-aea1-4e3b-9016-4c25dca9f779', 'body': {'volumeAttachment': {'volumeId': 'df1b6cd6-7430-4566-87b8-0476af2cea6a'}}} Aug 10 13:41:09.300586 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:41:09.300586 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:41:09.300586 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 13:41:09.300586 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 13:41:09.300586 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 13:41:09.300586 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 13:41:09.300586 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 10 13:41:09.300586 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 13:41:09.300586 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 10 13:41:09.300586 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 10 13:41:09.300586 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 10 13:41:09.300586 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 10 13:41:09.300586 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume df1b6cd6-7430-4566-87b8-0476af2cea6a is already attached to instances: 41baab24-f648-4e7d-83bb-4357214ea438 Aug 10 13:41:09.300586 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:41:09.300586 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:41:09.300586 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:41:09.300586 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:41:09.302055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:41:09.302055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:41:09.302055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:41:09.302055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:41:09.302055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:41:09.302055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:41:09.302055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 13:41:09.302055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 13:41:09.302055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 13:41:09.302055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 13:41:09.302055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 13:41:09.302055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 13:41:09.302055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 10 13:41:09.302055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 10 13:41:09.302055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume df1b6cd6-7430-4566-87b8-0476af2cea6a is already attached to instances: 41baab24-f648-4e7d-83bb-4357214ea438 Aug 10 13:41:09.302055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:41:09.302055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:41:09.302055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:41:09.302055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:41:09.302055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:41:09.303551 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:41:09.303551 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:41:09.303551 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:41:09.303551 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume df1b6cd6-7430-4566-87b8-0476af2cea6a is already attached to instances: 41baab24-f648-4e7d-83bb-4357214ea438 Aug 10 13:41:09.303551 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:41:09.303551 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-e7ff958e-900d-466b-b53a-98cfa99497a5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Returning 400 to user: Invalid volume: volume df1b6cd6-7430-4566-87b8-0476af2cea6a is already attached to instances: 41baab24-f648-4e7d-83bb-4357214ea438 {{(pid=129522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:41:09.303551 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-e7ff958e-900d-466b-b53a-98cfa99497a5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "POST /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105334 Aug 10 13:41:09.303551 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 238/452] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 10 13:41:09 2022] POST /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 10 13:41:09.308946 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-148721a7-1c8b-4335-b120-ed04335ebde0 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:09.309975 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-148721a7-1c8b-4335-b120-ed04335ebde0 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 0d6055de-aea1-4e3b-9016-4c25dca9f779] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:09.315862 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-148721a7-1c8b-4335-b120-ed04335ebde0 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:09.316343 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-148721a7-1c8b-4335-b120-ed04335ebde0 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:09.316772 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-148721a7-1c8b-4335-b120-ed04335ebde0 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:09.317479 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-148721a7-1c8b-4335-b120-ed04335ebde0 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:09.317928 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-148721a7-1c8b-4335-b120-ed04335ebde0 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:09.318349 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-148721a7-1c8b-4335-b120-ed04335ebde0 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:09.342756 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-148721a7-1c8b-4335-b120-ed04335ebde0 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 0d6055de-aea1-4e3b-9016-4c25dca9f779] Going to try to terminate instance {{(pid=129523) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:41:09.420185 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-148721a7-1c8b-4335-b120-ed04335ebde0 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779" status: 204 len: 0 microversion: 2.1 time: 0.114655 Aug 10 13:41:09.420793 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 215/453] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 10 13:41:09 2022] DELETE /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:41:09.429430 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-6e8d8a88-7408-4b06-9a3c-917c39500040 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:09.430067 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-6e8d8a88-7408-4b06-9a3c-917c39500040 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 0d6055de-aea1-4e3b-9016-4c25dca9f779] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:09.439507 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6e8d8a88-7408-4b06-9a3c-917c39500040 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:09.440105 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6e8d8a88-7408-4b06-9a3c-917c39500040 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:09.440467 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6e8d8a88-7408-4b06-9a3c-917c39500040 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:09.441255 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6e8d8a88-7408-4b06-9a3c-917c39500040 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:09.441715 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6e8d8a88-7408-4b06-9a3c-917c39500040 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:09.442161 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6e8d8a88-7408-4b06-9a3c-917c39500040 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:09.571844 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-6e8d8a88-7408-4b06-9a3c-917c39500040 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:09.579317 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-6e8d8a88-7408-4b06-9a3c-917c39500040 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779" status: 200 len: 1680 microversion: 2.1 time: 0.153908 Aug 10 13:41:09.579877 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 239/454] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:09 2022] GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:09.615707 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-af97f1db-6c70-4055-a7a0-d3e1d5660a3b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:09.616342 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-af97f1db-6c70-4055-a7a0-d3e1d5660a3b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:09.622547 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-af97f1db-6c70-4055-a7a0-d3e1d5660a3b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:09.623036 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-af97f1db-6c70-4055-a7a0-d3e1d5660a3b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:09.623493 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-af97f1db-6c70-4055-a7a0-d3e1d5660a3b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:09.624179 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-af97f1db-6c70-4055-a7a0-d3e1d5660a3b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:09.624632 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-af97f1db-6c70-4055-a7a0-d3e1d5660a3b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:09.625080 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-af97f1db-6c70-4055-a7a0-d3e1d5660a3b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:09.751609 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-af97f1db-6c70-4055-a7a0-d3e1d5660a3b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:09.760476 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-af97f1db-6c70-4055-a7a0-d3e1d5660a3b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:09.762004 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-af97f1db-6c70-4055-a7a0-d3e1d5660a3b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:09.763155 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-af97f1db-6c70-4055-a7a0-d3e1d5660a3b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1797 microversion: 2.20 time: 0.152609 Aug 10 13:41:09.763721 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 216/455] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:41:09 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1797 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:41:10.599988 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-c8f9db0f-f17f-4597-8c7f-fa188c5837b4 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:10.600594 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-c8f9db0f-f17f-4597-8c7f-fa188c5837b4 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 0d6055de-aea1-4e3b-9016-4c25dca9f779] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:10.607332 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c8f9db0f-f17f-4597-8c7f-fa188c5837b4 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:10.607816 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c8f9db0f-f17f-4597-8c7f-fa188c5837b4 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:10.608253 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c8f9db0f-f17f-4597-8c7f-fa188c5837b4 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:10.608941 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c8f9db0f-f17f-4597-8c7f-fa188c5837b4 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:10.609450 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c8f9db0f-f17f-4597-8c7f-fa188c5837b4 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:10.609875 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c8f9db0f-f17f-4597-8c7f-fa188c5837b4 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:10.739450 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-c8f9db0f-f17f-4597-8c7f-fa188c5837b4 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:10.746865 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-c8f9db0f-f17f-4597-8c7f-fa188c5837b4 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779" status: 200 len: 1680 microversion: 2.1 time: 0.150704 Aug 10 13:41:10.747418 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 240/456] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:10 2022] GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:11.767951 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-08197e74-b08e-45f4-a1de-0e96fc9f1fc8 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:11.768573 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-08197e74-b08e-45f4-a1de-0e96fc9f1fc8 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 0d6055de-aea1-4e3b-9016-4c25dca9f779] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:11.774878 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-08197e74-b08e-45f4-a1de-0e96fc9f1fc8 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:11.775357 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-08197e74-b08e-45f4-a1de-0e96fc9f1fc8 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:11.775791 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-08197e74-b08e-45f4-a1de-0e96fc9f1fc8 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:11.776480 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-08197e74-b08e-45f4-a1de-0e96fc9f1fc8 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:11.776934 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-08197e74-b08e-45f4-a1de-0e96fc9f1fc8 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:11.777385 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-08197e74-b08e-45f4-a1de-0e96fc9f1fc8 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:11.852623 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-08197e74-b08e-45f4-a1de-0e96fc9f1fc8 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:11.860343 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-08197e74-b08e-45f4-a1de-0e96fc9f1fc8 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779" status: 200 len: 1613 microversion: 2.1 time: 0.096185 Aug 10 13:41:11.861142 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 217/457] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:11 2022] GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779 => generated 1613 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:12.157763 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-7388abdc-5b83-4c25-a27d-86067ec2f70b req-fe18848e-7e71-4566-9abb-d4085f3c1e2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d6055de-aea1-4e3b-9016-4c25dca9f779", "name": "network-vif-deleted", "tag": "609518cd-9119-4805-aafe-d15f58ca5d2b"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:41:12.182029 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-7388abdc-5b83-4c25-a27d-86067ec2f70b req-fe18848e-7e71-4566-9abb-d4085f3c1e2a service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:12.182802 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-7388abdc-5b83-4c25-a27d-86067ec2f70b req-fe18848e-7e71-4566-9abb-d4085f3c1e2a service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:12.183372 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-7388abdc-5b83-4c25-a27d-86067ec2f70b req-fe18848e-7e71-4566-9abb-d4085f3c1e2a service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:12.195547 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-7388abdc-5b83-4c25-a27d-86067ec2f70b req-fe18848e-7e71-4566-9abb-d4085f3c1e2a service nova] Creating event network-vif-deleted:609518cd-9119-4805-aafe-d15f58ca5d2b for instance 0d6055de-aea1-4e3b-9016-4c25dca9f779 on hv-cinder-85200 Aug 10 13:41:12.200821 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-7388abdc-5b83-4c25-a27d-86067ec2f70b req-fe18848e-7e71-4566-9abb-d4085f3c1e2a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052433 Aug 10 13:41:12.201661 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 241/458] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:41:12.888882 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-3c69b4de-064d-4a10-b953-2fa0bb70947e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:12.889743 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-3c69b4de-064d-4a10-b953-2fa0bb70947e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 0d6055de-aea1-4e3b-9016-4c25dca9f779] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:12.902248 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3c69b4de-064d-4a10-b953-2fa0bb70947e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:12.903437 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3c69b4de-064d-4a10-b953-2fa0bb70947e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:12.904233 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3c69b4de-064d-4a10-b953-2fa0bb70947e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:12.907188 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3c69b4de-064d-4a10-b953-2fa0bb70947e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:12.907662 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3c69b4de-064d-4a10-b953-2fa0bb70947e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:12.908097 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3c69b4de-064d-4a10-b953-2fa0bb70947e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:12.948377 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3c69b4de-064d-4a10-b953-2fa0bb70947e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:12.948889 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3c69b4de-064d-4a10-b953-2fa0bb70947e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:12.949369 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3c69b4de-064d-4a10-b953-2fa0bb70947e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:12.949812 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.objects.instance [None req-3c69b4de-064d-4a10-b953-2fa0bb70947e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lazy-loading 'fault' on Instance uuid 0d6055de-aea1-4e3b-9016-4c25dca9f779 {{(pid=129523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:41:12.996217 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-3c69b4de-064d-4a10-b953-2fa0bb70947e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:13.011664 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-3c69b4de-064d-4a10-b953-2fa0bb70947e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779" status: 200 len: 1330 microversion: 2.1 time: 0.126572 Aug 10 13:41:13.011664 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 218/459] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:12 2022] GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779 => generated 1330 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:13.710602 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-e3f02d66-8def-4d89-9261-113cda314d6c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:41:13.712780 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-e3f02d66-8def-4d89-9261-113cda314d6c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:13.718938 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e3f02d66-8def-4d89-9261-113cda314d6c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:13.719421 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e3f02d66-8def-4d89-9261-113cda314d6c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:13.719856 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e3f02d66-8def-4d89-9261-113cda314d6c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:13.720548 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e3f02d66-8def-4d89-9261-113cda314d6c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:13.721584 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e3f02d66-8def-4d89-9261-113cda314d6c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:13.722011 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e3f02d66-8def-4d89-9261-113cda314d6c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:13.749381 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.objects.instance [None req-e3f02d66-8def-4d89-9261-113cda314d6c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lazy-loading 'flavor' on Instance uuid 51cd434d-31c3-4588-aed7-48e7130c5131 {{(pid=129522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:41:13.884846 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-e3f02d66-8def-4d89-9261-113cda314d6c tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "POST /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131/action" status: 200 len: 32 microversion: 2.1 time: 0.179641 Aug 10 13:41:13.885586 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 242/460] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 10 13:41:13 2022] POST /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131/action => generated 32 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 13:41:13.897297 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-65f00c5d-3656-4042-996a-2bf7f983f162 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:13.898043 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-65f00c5d-3656-4042-996a-2bf7f983f162 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:13.904739 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-65f00c5d-3656-4042-996a-2bf7f983f162 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:13.905220 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-65f00c5d-3656-4042-996a-2bf7f983f162 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:13.905708 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-65f00c5d-3656-4042-996a-2bf7f983f162 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:13.906471 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-65f00c5d-3656-4042-996a-2bf7f983f162 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:13.906932 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-65f00c5d-3656-4042-996a-2bf7f983f162 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:13.907348 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-65f00c5d-3656-4042-996a-2bf7f983f162 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:14.029542 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-50ce27fa-8a96-4d65-9a53-1064aa2c1dc5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:14.030595 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-50ce27fa-8a96-4d65-9a53-1064aa2c1dc5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 0d6055de-aea1-4e3b-9016-4c25dca9f779] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:14.040582 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-50ce27fa-8a96-4d65-9a53-1064aa2c1dc5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:14.041178 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-50ce27fa-8a96-4d65-9a53-1064aa2c1dc5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:14.041781 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-50ce27fa-8a96-4d65-9a53-1064aa2c1dc5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:14.043765 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-50ce27fa-8a96-4d65-9a53-1064aa2c1dc5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:14.043765 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-50ce27fa-8a96-4d65-9a53-1064aa2c1dc5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:14.043765 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-50ce27fa-8a96-4d65-9a53-1064aa2c1dc5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:14.048785 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:41:14.063314 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.wsgi [None req-50ce27fa-8a96-4d65-9a53-1064aa2c1dc5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] HTTP exception thrown: Instance 0d6055de-aea1-4e3b-9016-4c25dca9f779 could not be found. Aug 10 13:41:14.065339 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-50ce27fa-8a96-4d65-9a53-1064aa2c1dc5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Request method failure captured: Aug 10 13:41:14.065339 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: request: GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779 HTTP/1.1 Aug 10 13:41:14.065339 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept: application/json Aug 10 13:41:14.065339 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept-Encoding: identity Aug 10 13:41:14.065339 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Connection: close Aug 10 13:41:14.065339 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Length: 0 Aug 10 13:41:14.065339 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Type: application/json Aug 10 13:41:14.065339 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Host: 10.222.0.52 Aug 10 13:41:14.065339 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Openstack-System-Scope: None Aug 10 13:41:14.065339 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: User-Agent: python-urllib3/1.26.11 Aug 10 13:41:14.065339 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Auth-Token: gAAAAABi87Sor1QukN8WwkCMRH0utTzHqdtW9hBypcULvW8_thEN8NIRbRb3dRFY62pVCieUmq7t4p3U1aqc6NH3mLhkTq5eSrbHxF5HfdCRrvoVeQ0o3DpawgBQQZEUeD2RccyRTg2LrZLPb9H0A6tO9wPr-HvRM84fUPq4D0GzK22Ap72p14g Aug 10 13:41:14.065339 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Id: None Aug 10 13:41:14.065339 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Name: None Aug 10 13:41:14.065339 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Identity-Status: Confirmed Aug 10 13:41:14.065339 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Is-Admin-Project: True Aug 10 13:41:14.065339 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Id: default Aug 10 13:41:14.065339 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Name: Default Aug 10 13:41:14.065339 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Id: 48e5556cbbfd4b00aa4f6055cd6238b2 Aug 10 13:41:14.065339 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Name: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:41:14.065339 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Role: member,reader Aug 10 13:41:14.065339 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Roles: member,reader Aug 10 13:41:14.066688 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/48e5556cbbfd4b00aa4f6055cd6238b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48e5556cbbfd4b00aa4f6055cd6238b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_48e5556cbbfd4b00aa4f6055cd6238b2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48e5556cbbfd4b00aa4f6055cd6238b2"}]}] Aug 10 13:41:14.066688 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:41:14.066688 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Id: 48e5556cbbfd4b00aa4f6055cd6238b2 Aug 10 13:41:14.066688 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:41:14.066688 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User: tempest-AttachVolumeNegativeTest-965925392-project Aug 10 13:41:14.066688 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Id: default Aug 10 13:41:14.066688 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Name: Default Aug 10 13:41:14.066688 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Id: a3d9e5dc719c430eac6b5c8d8b814566 Aug 10 13:41:14.066688 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Name: tempest-AttachVolumeNegativeTest-965925392-project Aug 10 13:41:14.066688 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: method: > Aug 10 13:41:14.066688 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: exception: Instance 0d6055de-aea1-4e3b-9016-4c25dca9f779 could not be found. Aug 10 13:41:14.066688 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: action_args: {'id': '0d6055de-aea1-4e3b-9016-4c25dca9f779'} Aug 10 13:41:14.067925 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:41:14.067925 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:41:14.067925 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:41:14.067925 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:41:14.067925 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:41:14.067925 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:41:14.067925 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:41:14.067925 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:41:14.067925 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:41:14.067925 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:41:14.067925 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d6055de-aea1-4e3b-9016-4c25dca9f779 could not be found. Aug 10 13:41:14.067925 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:41:14.067925 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:41:14.067925 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:41:14.067925 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:41:14.067925 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:41:14.067925 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:41:14.067925 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:41:14.067925 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:41:14.067925 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:41:14.070401 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:41:14.070401 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:41:14.070401 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:41:14.070401 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:41:14.070401 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:41:14.070401 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:41:14.070401 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:41:14.070401 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d6055de-aea1-4e3b-9016-4c25dca9f779 could not be found. Aug 10 13:41:14.070401 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:41:14.070401 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:41:14.070401 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:41:14.070401 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:41:14.070401 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:41:14.070401 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:41:14.070401 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:41:14.070401 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:41:14.070401 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d6055de-aea1-4e3b-9016-4c25dca9f779 could not be found. Aug 10 13:41:14.070401 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:41:14.074521 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-50ce27fa-8a96-4d65-9a53-1064aa2c1dc5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Returning 404 to user: Instance 0d6055de-aea1-4e3b-9016-4c25dca9f779 could not be found. {{(pid=129522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:41:14.074521 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-50ce27fa-8a96-4d65-9a53-1064aa2c1dc5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779" status: 404 len: 111 microversion: 2.1 time: 0.042651 Aug 10 13:41:14.074521 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 243/461] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:14 2022] GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 13:41:14.077854 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-cd890ee8-e1de-48ac-b122-99ca6483f552 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '.version_select at 0x7f49c46c89d0>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:14.107059 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-cd890ee8-e1de-48ac-b122-99ca6483f552 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-753633501" status: 202 len: 0 microversion: 2.1 time: 0.033859 Aug 10 13:41:14.124525 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 244/462] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Aug 10 13:41:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-753633501 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:41:14.148699 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-65f00c5d-3656-4042-996a-2bf7f983f162 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:14.167138 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-65f00c5d-3656-4042-996a-2bf7f983f162 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1735 microversion: 2.1 time: 0.273917 Aug 10 13:41:14.173470 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 219/463] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:13 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1735 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:14.874325 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-dea6c398-5314-4b09-bb50-a5879118029a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:14.874907 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-dea6c398-5314-4b09-bb50-a5879118029a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 41baab24-f648-4e7d-83bb-4357214ea438] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:14.881423 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-dea6c398-5314-4b09-bb50-a5879118029a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:14.881905 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-dea6c398-5314-4b09-bb50-a5879118029a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:14.882335 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-dea6c398-5314-4b09-bb50-a5879118029a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:14.883013 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-dea6c398-5314-4b09-bb50-a5879118029a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:14.883458 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-dea6c398-5314-4b09-bb50-a5879118029a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:14.883874 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-dea6c398-5314-4b09-bb50-a5879118029a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:15.013860 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.objects.instance [None req-dea6c398-5314-4b09-bb50-a5879118029a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lazy-loading 'services' on Instance uuid 41baab24-f648-4e7d-83bb-4357214ea438 {{(pid=129522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:41:15.126976 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-dea6c398-5314-4b09-bb50-a5879118029a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "DELETE /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438/os-volume_attachments/df1b6cd6-7430-4566-87b8-0476af2cea6a" status: 202 len: 0 microversion: 2.1 time: 0.256462 Aug 10 13:41:15.128073 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 245/464] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Aug 10 13:41:14 2022] DELETE /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438/os-volume_attachments/df1b6cd6-7430-4566-87b8-0476af2cea6a => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:41:15.136726 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-982d4af9-3152-412f-9738-6cdecf6c1e9f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:15.139042 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-982d4af9-3152-412f-9738-6cdecf6c1e9f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 41baab24-f648-4e7d-83bb-4357214ea438] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:15.141516 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:41:15.148351 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-982d4af9-3152-412f-9738-6cdecf6c1e9f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:15.148752 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-982d4af9-3152-412f-9738-6cdecf6c1e9f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:15.149298 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-982d4af9-3152-412f-9738-6cdecf6c1e9f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:15.149944 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-982d4af9-3152-412f-9738-6cdecf6c1e9f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:15.150340 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-982d4af9-3152-412f-9738-6cdecf6c1e9f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:15.150754 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-982d4af9-3152-412f-9738-6cdecf6c1e9f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:15.180545 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-982d4af9-3152-412f-9738-6cdecf6c1e9f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047925 Aug 10 13:41:15.181088 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 220/465] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 10 13:41:15 2022] GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:41:15.191637 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-408763a3-962d-4efe-a38f-84f3d18e9006 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:15.192364 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-408763a3-962d-4efe-a38f-84f3d18e9006 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:15.198894 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-408763a3-962d-4efe-a38f-84f3d18e9006 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:15.199976 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-408763a3-962d-4efe-a38f-84f3d18e9006 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:15.200411 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-408763a3-962d-4efe-a38f-84f3d18e9006 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:15.201470 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-408763a3-962d-4efe-a38f-84f3d18e9006 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:15.202052 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-408763a3-962d-4efe-a38f-84f3d18e9006 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:15.202473 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-408763a3-962d-4efe-a38f-84f3d18e9006 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:15.361048 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-408763a3-962d-4efe-a38f-84f3d18e9006 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:15.370408 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-408763a3-962d-4efe-a38f-84f3d18e9006 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1735 microversion: 2.1 time: 0.183201 Aug 10 13:41:15.371132 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 246/466] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:15 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:16.192913 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-86e9352e-cae7-49b5-979b-d68367a35f67 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:16.195271 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-86e9352e-cae7-49b5-979b-d68367a35f67 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 41baab24-f648-4e7d-83bb-4357214ea438] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:16.202154 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-86e9352e-cae7-49b5-979b-d68367a35f67 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:16.202645 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-86e9352e-cae7-49b5-979b-d68367a35f67 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:16.203086 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-86e9352e-cae7-49b5-979b-d68367a35f67 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:16.203784 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-86e9352e-cae7-49b5-979b-d68367a35f67 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:16.204238 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-86e9352e-cae7-49b5-979b-d68367a35f67 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:16.204665 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-86e9352e-cae7-49b5-979b-d68367a35f67 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:16.208520 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:41:16.238904 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-86e9352e-cae7-49b5-979b-d68367a35f67 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050511 Aug 10 13:41:16.239469 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 221/467] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 10 13:41:16 2022] GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:41:16.393201 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-d883b09b-6024-4964-a139-21972e7ff544 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:16.393909 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-d883b09b-6024-4964-a139-21972e7ff544 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:16.400388 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d883b09b-6024-4964-a139-21972e7ff544 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:16.400865 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d883b09b-6024-4964-a139-21972e7ff544 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:16.401319 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d883b09b-6024-4964-a139-21972e7ff544 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:16.402099 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d883b09b-6024-4964-a139-21972e7ff544 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:16.402542 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d883b09b-6024-4964-a139-21972e7ff544 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:16.402955 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d883b09b-6024-4964-a139-21972e7ff544 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:16.545131 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-d883b09b-6024-4964-a139-21972e7ff544 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:16.553073 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-d883b09b-6024-4964-a139-21972e7ff544 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1735 microversion: 2.1 time: 0.164981 Aug 10 13:41:16.553668 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 247/468] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:16 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:17.251165 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-9a6603c5-c6e1-4cfe-a824-47801b5ddc8a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:17.253480 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-9a6603c5-c6e1-4cfe-a824-47801b5ddc8a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 41baab24-f648-4e7d-83bb-4357214ea438] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:17.259973 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9a6603c5-c6e1-4cfe-a824-47801b5ddc8a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:17.260455 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9a6603c5-c6e1-4cfe-a824-47801b5ddc8a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:17.260889 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9a6603c5-c6e1-4cfe-a824-47801b5ddc8a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:17.261611 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9a6603c5-c6e1-4cfe-a824-47801b5ddc8a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:17.262064 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9a6603c5-c6e1-4cfe-a824-47801b5ddc8a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:17.262484 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9a6603c5-c6e1-4cfe-a824-47801b5ddc8a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:17.292293 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-9a6603c5-c6e1-4cfe-a824-47801b5ddc8a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045395 Aug 10 13:41:17.292922 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 222/469] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 10 13:41:17 2022] GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 13:41:17.363753 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-cf320859-79f8-476e-b106-0e10b04ea60a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:17.364249 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-cf320859-79f8-476e-b106-0e10b04ea60a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 41baab24-f648-4e7d-83bb-4357214ea438] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:17.370161 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cf320859-79f8-476e-b106-0e10b04ea60a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:17.370643 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cf320859-79f8-476e-b106-0e10b04ea60a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:17.371074 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cf320859-79f8-476e-b106-0e10b04ea60a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:17.371755 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cf320859-79f8-476e-b106-0e10b04ea60a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:17.372202 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cf320859-79f8-476e-b106-0e10b04ea60a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:17.372648 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cf320859-79f8-476e-b106-0e10b04ea60a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:17.397721 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-cf320859-79f8-476e-b106-0e10b04ea60a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 41baab24-f648-4e7d-83bb-4357214ea438] Going to try to terminate instance {{(pid=129522) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:41:17.481663 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-cf320859-79f8-476e-b106-0e10b04ea60a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "DELETE /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438" status: 204 len: 0 microversion: 2.1 time: 0.121682 Aug 10 13:41:17.482249 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 248/470] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 10 13:41:17 2022] DELETE /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:41:17.492685 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-ffebd8b6-47ee-4848-8d16-6d379f041ce2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:17.493525 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-ffebd8b6-47ee-4848-8d16-6d379f041ce2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 41baab24-f648-4e7d-83bb-4357214ea438] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:17.499910 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ffebd8b6-47ee-4848-8d16-6d379f041ce2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:17.500397 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ffebd8b6-47ee-4848-8d16-6d379f041ce2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:17.500833 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ffebd8b6-47ee-4848-8d16-6d379f041ce2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:17.501603 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ffebd8b6-47ee-4848-8d16-6d379f041ce2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:17.502557 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ffebd8b6-47ee-4848-8d16-6d379f041ce2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:17.503009 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ffebd8b6-47ee-4848-8d16-6d379f041ce2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:17.574945 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-3070866c-b707-43d3-8d73-f7e2dfe188bd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:17.575648 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-3070866c-b707-43d3-8d73-f7e2dfe188bd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:17.581749 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3070866c-b707-43d3-8d73-f7e2dfe188bd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:17.582234 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3070866c-b707-43d3-8d73-f7e2dfe188bd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:17.582666 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3070866c-b707-43d3-8d73-f7e2dfe188bd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:17.583355 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3070866c-b707-43d3-8d73-f7e2dfe188bd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:17.583806 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3070866c-b707-43d3-8d73-f7e2dfe188bd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:17.584225 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3070866c-b707-43d3-8d73-f7e2dfe188bd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:17.644411 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-ffebd8b6-47ee-4848-8d16-6d379f041ce2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:17.652182 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-ffebd8b6-47ee-4848-8d16-6d379f041ce2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438" status: 200 len: 1684 microversion: 2.1 time: 0.164906 Aug 10 13:41:17.653113 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 223/471] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:17 2022] GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438 => generated 1684 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:17.731681 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-3070866c-b707-43d3-8d73-f7e2dfe188bd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:17.740365 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-3070866c-b707-43d3-8d73-f7e2dfe188bd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1735 microversion: 2.1 time: 0.169621 Aug 10 13:41:17.740928 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 249/472] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:17 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:41:18.674203 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-77f50967-005e-488c-8193-9248848e4141 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:18.674812 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-77f50967-005e-488c-8193-9248848e4141 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 41baab24-f648-4e7d-83bb-4357214ea438] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:18.681125 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-77f50967-005e-488c-8193-9248848e4141 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:18.681772 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-77f50967-005e-488c-8193-9248848e4141 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:18.682351 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-77f50967-005e-488c-8193-9248848e4141 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:18.683106 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-77f50967-005e-488c-8193-9248848e4141 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:18.683554 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-77f50967-005e-488c-8193-9248848e4141 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:18.683971 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-77f50967-005e-488c-8193-9248848e4141 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:18.763134 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-47d7143d-eba5-44e9-b33f-bce367e38e19 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:18.763939 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-47d7143d-eba5-44e9-b33f-bce367e38e19 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:18.770725 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-47d7143d-eba5-44e9-b33f-bce367e38e19 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:18.771292 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-47d7143d-eba5-44e9-b33f-bce367e38e19 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:18.771819 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-47d7143d-eba5-44e9-b33f-bce367e38e19 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:18.772590 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-47d7143d-eba5-44e9-b33f-bce367e38e19 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:18.773109 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-47d7143d-eba5-44e9-b33f-bce367e38e19 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:18.773567 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-47d7143d-eba5-44e9-b33f-bce367e38e19 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:18.812269 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-77f50967-005e-488c-8193-9248848e4141 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:18.820533 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-77f50967-005e-488c-8193-9248848e4141 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438" status: 200 len: 1684 microversion: 2.1 time: 0.150081 Aug 10 13:41:18.821099 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 224/473] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:18 2022] GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438 => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:18.902124 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-47d7143d-eba5-44e9-b33f-bce367e38e19 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:18.910427 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-47d7143d-eba5-44e9-b33f-bce367e38e19 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1735 microversion: 2.1 time: 0.151453 Aug 10 13:41:18.910988 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 250/474] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:18 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:41:19.842167 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-48d47ab3-da23-4384-aa4a-8a7555104062 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:19.842954 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-48d47ab3-da23-4384-aa4a-8a7555104062 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 41baab24-f648-4e7d-83bb-4357214ea438] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:19.850124 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-48d47ab3-da23-4384-aa4a-8a7555104062 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:19.850670 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-48d47ab3-da23-4384-aa4a-8a7555104062 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:19.851154 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-48d47ab3-da23-4384-aa4a-8a7555104062 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:19.851897 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-48d47ab3-da23-4384-aa4a-8a7555104062 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:19.852397 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-48d47ab3-da23-4384-aa4a-8a7555104062 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:19.852863 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-48d47ab3-da23-4384-aa4a-8a7555104062 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:19.932110 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-d3fcbc84-2007-4eaa-90f7-be4634d1d5e6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:19.932715 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-d3fcbc84-2007-4eaa-90f7-be4634d1d5e6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:19.939377 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d3fcbc84-2007-4eaa-90f7-be4634d1d5e6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:19.940125 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d3fcbc84-2007-4eaa-90f7-be4634d1d5e6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:19.940563 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d3fcbc84-2007-4eaa-90f7-be4634d1d5e6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:19.941715 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d3fcbc84-2007-4eaa-90f7-be4634d1d5e6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:19.941715 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d3fcbc84-2007-4eaa-90f7-be4634d1d5e6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:19.942126 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d3fcbc84-2007-4eaa-90f7-be4634d1d5e6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:20.066602 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-48d47ab3-da23-4384-aa4a-8a7555104062 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:20.074473 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-d3fcbc84-2007-4eaa-90f7-be4634d1d5e6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:20.074778 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-48d47ab3-da23-4384-aa4a-8a7555104062 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438" status: 200 len: 1684 microversion: 2.1 time: 0.236787 Aug 10 13:41:20.075599 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 225/475] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:19 2022] GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438 => generated 1684 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:20.083640 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-d3fcbc84-2007-4eaa-90f7-be4634d1d5e6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1735 microversion: 2.1 time: 0.156063 Aug 10 13:41:20.084493 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 251/476] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:19 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:41:20.419506 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-513f5c4d-c9dd-471d-b594-e9965047bfbd tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:20.420079 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-513f5c4d-c9dd-471d-b594-e9965047bfbd tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:20.426505 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-513f5c4d-c9dd-471d-b594-e9965047bfbd tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:20.427012 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-513f5c4d-c9dd-471d-b594-e9965047bfbd tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:20.427426 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-513f5c4d-c9dd-471d-b594-e9965047bfbd tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:20.428118 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-513f5c4d-c9dd-471d-b594-e9965047bfbd tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:20.428570 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-513f5c4d-c9dd-471d-b594-e9965047bfbd tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:20.428991 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-513f5c4d-c9dd-471d-b594-e9965047bfbd tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:20.561713 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.objects.instance [None req-513f5c4d-c9dd-471d-b594-e9965047bfbd tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lazy-loading 'services' on Instance uuid 589498ff-2901-49e5-91c2-0275f4dcf522 {{(pid=129523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:41:20.684014 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-513f5c4d-c9dd-471d-b594-e9965047bfbd tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "DELETE /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522/os-volume_attachments/3635fa7e-0321-46bd-ac3f-c4dd9f6aa5c5" status: 202 len: 0 microversion: 2.1 time: 0.268400 Aug 10 13:41:20.685062 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 226/477] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Aug 10 13:41:20 2022] DELETE /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522/os-volume_attachments/3635fa7e-0321-46bd-ac3f-c4dd9f6aa5c5 => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:41:20.852566 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-4ca8cc8e-68df-49a0-83d3-2d8dd52f64c6 req-b6ad3970-eee7-4d90-a6f3-36ee325301b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41baab24-f648-4e7d-83bb-4357214ea438", "name": "network-vif-deleted", "tag": "094ff493-e302-4b0c-96d5-f742648c5682"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:41:20.864126 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-4ca8cc8e-68df-49a0-83d3-2d8dd52f64c6 req-b6ad3970-eee7-4d90-a6f3-36ee325301b6 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:20.864690 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-4ca8cc8e-68df-49a0-83d3-2d8dd52f64c6 req-b6ad3970-eee7-4d90-a6f3-36ee325301b6 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:20.865167 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-4ca8cc8e-68df-49a0-83d3-2d8dd52f64c6 req-b6ad3970-eee7-4d90-a6f3-36ee325301b6 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:20.877621 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-4ca8cc8e-68df-49a0-83d3-2d8dd52f64c6 req-b6ad3970-eee7-4d90-a6f3-36ee325301b6 service nova] Creating event network-vif-deleted:094ff493-e302-4b0c-96d5-f742648c5682 for instance 41baab24-f648-4e7d-83bb-4357214ea438 on hv-cinder-85200 Aug 10 13:41:20.882523 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-4ca8cc8e-68df-49a0-83d3-2d8dd52f64c6 req-b6ad3970-eee7-4d90-a6f3-36ee325301b6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033739 Aug 10 13:41:20.883109 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 252/478] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:41:21.097458 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-7ecbe59c-5cdb-477f-86b5-75a63df98658 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:21.099402 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-7ecbe59c-5cdb-477f-86b5-75a63df98658 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 41baab24-f648-4e7d-83bb-4357214ea438] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:21.105367 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7ecbe59c-5cdb-477f-86b5-75a63df98658 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:21.106227 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7ecbe59c-5cdb-477f-86b5-75a63df98658 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:21.106722 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-d38cfa2c-af15-47f8-93cc-23593bac8171 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:21.107256 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7ecbe59c-5cdb-477f-86b5-75a63df98658 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:21.107678 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-d38cfa2c-af15-47f8-93cc-23593bac8171 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:21.108227 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7ecbe59c-5cdb-477f-86b5-75a63df98658 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:21.108678 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7ecbe59c-5cdb-477f-86b5-75a63df98658 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:21.109131 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7ecbe59c-5cdb-477f-86b5-75a63df98658 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:21.115827 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d38cfa2c-af15-47f8-93cc-23593bac8171 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:21.116557 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d38cfa2c-af15-47f8-93cc-23593bac8171 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:21.117107 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d38cfa2c-af15-47f8-93cc-23593bac8171 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:21.117937 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d38cfa2c-af15-47f8-93cc-23593bac8171 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:21.118472 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d38cfa2c-af15-47f8-93cc-23593bac8171 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:21.118970 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d38cfa2c-af15-47f8-93cc-23593bac8171 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:21.189793 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-7ecbe59c-5cdb-477f-86b5-75a63df98658 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:21.200462 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-7ecbe59c-5cdb-477f-86b5-75a63df98658 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438" status: 200 len: 1616 microversion: 2.1 time: 0.108099 Aug 10 13:41:21.202461 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 227/479] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:21 2022] GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438 => generated 1616 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:21.293513 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-d38cfa2c-af15-47f8-93cc-23593bac8171 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:21.301771 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-d38cfa2c-af15-47f8-93cc-23593bac8171 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1735 microversion: 2.1 time: 0.200452 Aug 10 13:41:21.302349 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 253/480] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:21 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1735 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:21.828996 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-376d9a55-d23d-442f-93d5-8fa3bf284834 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:41:21.835213 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-376d9a55-d23d-442f-93d5-8fa3bf284834 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:21.835712 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-376d9a55-d23d-442f-93d5-8fa3bf284834 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:21.836154 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-376d9a55-d23d-442f-93d5-8fa3bf284834 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:21.899610 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-376d9a55-d23d-442f-93d5-8fa3bf284834 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Going to try to stop instance {{(pid=129523) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 10 13:41:21.946485 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-376d9a55-d23d-442f-93d5-8fa3bf284834 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "POST /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522/action" status: 202 len: 0 microversion: 2.1 time: 0.121195 Aug 10 13:41:21.947109 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 228/481] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 10 13:41:21 2022] POST /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:41:21.955027 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-059effb2-4215-4a68-9d79-d20d2a468385 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:21.955645 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-059effb2-4215-4a68-9d79-d20d2a468385 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:21.961814 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-059effb2-4215-4a68-9d79-d20d2a468385 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:21.962469 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-059effb2-4215-4a68-9d79-d20d2a468385 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:21.962900 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-059effb2-4215-4a68-9d79-d20d2a468385 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:21.963803 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-059effb2-4215-4a68-9d79-d20d2a468385 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:21.964531 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-059effb2-4215-4a68-9d79-d20d2a468385 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:21.965291 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-059effb2-4215-4a68-9d79-d20d2a468385 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:22.099878 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-059effb2-4215-4a68-9d79-d20d2a468385 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:22.107211 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-059effb2-4215-4a68-9d79-d20d2a468385 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1674 microversion: 2.1 time: 0.155959 Aug 10 13:41:22.107780 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 254/482] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:21 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:22.234118 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-f9c53082-c731-4758-8c16-b3e328d35817 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:22.234737 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-f9c53082-c731-4758-8c16-b3e328d35817 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 41baab24-f648-4e7d-83bb-4357214ea438] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:22.241596 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f9c53082-c731-4758-8c16-b3e328d35817 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:22.242078 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f9c53082-c731-4758-8c16-b3e328d35817 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:22.242516 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f9c53082-c731-4758-8c16-b3e328d35817 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:22.243197 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f9c53082-c731-4758-8c16-b3e328d35817 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:22.243679 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f9c53082-c731-4758-8c16-b3e328d35817 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:22.244100 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f9c53082-c731-4758-8c16-b3e328d35817 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:22.258050 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.wsgi [None req-f9c53082-c731-4758-8c16-b3e328d35817 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] HTTP exception thrown: Instance 41baab24-f648-4e7d-83bb-4357214ea438 could not be found. Aug 10 13:41:22.259655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-f9c53082-c731-4758-8c16-b3e328d35817 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Request method failure captured: Aug 10 13:41:22.259655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: request: GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438 HTTP/1.1 Aug 10 13:41:22.259655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept: application/json Aug 10 13:41:22.259655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept-Encoding: identity Aug 10 13:41:22.259655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Connection: close Aug 10 13:41:22.259655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Length: 0 Aug 10 13:41:22.259655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Type: application/json Aug 10 13:41:22.259655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Host: 10.222.0.52 Aug 10 13:41:22.259655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Openstack-System-Scope: None Aug 10 13:41:22.259655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: User-Agent: python-urllib3/1.26.11 Aug 10 13:41:22.259655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Auth-Token: gAAAAABi87Sor1QukN8WwkCMRH0utTzHqdtW9hBypcULvW8_thEN8NIRbRb3dRFY62pVCieUmq7t4p3U1aqc6NH3mLhkTq5eSrbHxF5HfdCRrvoVeQ0o3DpawgBQQZEUeD2RccyRTg2LrZLPb9H0A6tO9wPr-HvRM84fUPq4D0GzK22Ap72p14g Aug 10 13:41:22.259655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Id: None Aug 10 13:41:22.259655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Name: None Aug 10 13:41:22.259655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Identity-Status: Confirmed Aug 10 13:41:22.259655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Is-Admin-Project: True Aug 10 13:41:22.259655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Id: default Aug 10 13:41:22.259655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Name: Default Aug 10 13:41:22.259655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Id: 48e5556cbbfd4b00aa4f6055cd6238b2 Aug 10 13:41:22.259655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Name: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:41:22.259655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Role: member,reader Aug 10 13:41:22.259655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Roles: member,reader Aug 10 13:41:22.261293 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/48e5556cbbfd4b00aa4f6055cd6238b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48e5556cbbfd4b00aa4f6055cd6238b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_48e5556cbbfd4b00aa4f6055cd6238b2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48e5556cbbfd4b00aa4f6055cd6238b2"}]}] Aug 10 13:41:22.261293 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:41:22.261293 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Id: 48e5556cbbfd4b00aa4f6055cd6238b2 Aug 10 13:41:22.261293 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:41:22.261293 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User: tempest-AttachVolumeNegativeTest-965925392-project Aug 10 13:41:22.261293 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Id: default Aug 10 13:41:22.261293 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Name: Default Aug 10 13:41:22.261293 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Id: a3d9e5dc719c430eac6b5c8d8b814566 Aug 10 13:41:22.261293 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Name: tempest-AttachVolumeNegativeTest-965925392-project Aug 10 13:41:22.261293 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: method: > Aug 10 13:41:22.261293 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: exception: Instance 41baab24-f648-4e7d-83bb-4357214ea438 could not be found. Aug 10 13:41:22.261293 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: action_args: {'id': '41baab24-f648-4e7d-83bb-4357214ea438'} Aug 10 13:41:22.262381 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:41:22.262381 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:41:22.262381 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:41:22.262381 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:41:22.262381 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:41:22.262381 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:41:22.262381 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:41:22.262381 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:41:22.262381 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:41:22.262381 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:41:22.262381 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41baab24-f648-4e7d-83bb-4357214ea438 could not be found. Aug 10 13:41:22.262381 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:41:22.262381 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:41:22.262381 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:41:22.262381 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:41:22.262381 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:41:22.262381 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:41:22.262381 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:41:22.262381 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:41:22.262381 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:41:22.263762 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:41:22.263762 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:41:22.263762 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:41:22.263762 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:41:22.263762 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:41:22.263762 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:41:22.263762 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:41:22.263762 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41baab24-f648-4e7d-83bb-4357214ea438 could not be found. Aug 10 13:41:22.263762 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:41:22.263762 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:41:22.263762 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:41:22.263762 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:41:22.263762 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:41:22.263762 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:41:22.263762 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:41:22.263762 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:41:22.263762 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41baab24-f648-4e7d-83bb-4357214ea438 could not be found. Aug 10 13:41:22.263762 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:41:22.265094 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-f9c53082-c731-4758-8c16-b3e328d35817 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Returning 404 to user: Instance 41baab24-f648-4e7d-83bb-4357214ea438 could not be found. {{(pid=129523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:41:22.265094 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-f9c53082-c731-4758-8c16-b3e328d35817 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438" status: 404 len: 111 microversion: 2.1 time: 0.031656 Aug 10 13:41:22.265094 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 229/483] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:22 2022] GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:41:22.270615 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-994bad1b-1b94-45fc-835d-0d8af11c7ef3 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '.version_select at 0x7f49c4617af0>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:22.289274 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-994bad1b-1b94-45fc-835d-0d8af11c7ef3 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1148496587" status: 202 len: 0 microversion: 2.1 time: 0.022918 Aug 10 13:41:22.289844 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 255/484] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Aug 10 13:41:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1148496587 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:41:22.323613 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-9ab43a37-8d80-47c7-9e14-a747f1128e37 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:22.324319 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-9ab43a37-8d80-47c7-9e14-a747f1128e37 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:22.330836 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9ab43a37-8d80-47c7-9e14-a747f1128e37 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:22.331394 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9ab43a37-8d80-47c7-9e14-a747f1128e37 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:22.331828 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9ab43a37-8d80-47c7-9e14-a747f1128e37 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:22.332514 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9ab43a37-8d80-47c7-9e14-a747f1128e37 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:22.332995 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9ab43a37-8d80-47c7-9e14-a747f1128e37 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:22.333453 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9ab43a37-8d80-47c7-9e14-a747f1128e37 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:22.473523 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-9ab43a37-8d80-47c7-9e14-a747f1128e37 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:22.481928 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-9ab43a37-8d80-47c7-9e14-a747f1128e37 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1735 microversion: 2.1 time: 0.162204 Aug 10 13:41:22.493626 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 230/485] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:22 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:22.905864 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-568a41a8-85db-4229-8968-99e8e2b9b6ec tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Action: 'create', calling method: .version_select at 0x7f49c46c8f70>, body: {"keypair": {"name": "tempest-keypair-1512207296", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+XuU6nXKMa1Hb4HpoeP2CGdTXcPpgz/3/B4WqFTU6Zs0iQe+X4U+UU9W9kccyc6cutIUipH0O1aetdCrGGrCLscAQN/s0WXZu/cwU4SFYrj6Bhmx0CeRZeR09+yTpSHg=="}} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:41:22.921971 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.quota [None req-568a41a8-85db-4229-8968-99e8e2b9b6ec tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Getting quotas for project 48e5556cbbfd4b00aa4f6055cd6238b2. Resources: {'key_pairs'} {{(pid=129522) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:41:22.925771 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.quota [None req-568a41a8-85db-4229-8968-99e8e2b9b6ec tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Getting quotas for user a3d9e5dc719c430eac6b5c8d8b814566 and project 48e5556cbbfd4b00aa4f6055cd6238b2. Resources: {'key_pairs'} {{(pid=129522) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:41:22.946397 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-568a41a8-85db-4229-8968-99e8e2b9b6ec tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044327 Aug 10 13:41:22.946997 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 256/486] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Aug 10 13:41:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:41:23.129594 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-bb5dc9c2-e638-4900-b4cd-80a294add3e7 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:23.130213 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-bb5dc9c2-e638-4900-b4cd-80a294add3e7 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:23.136170 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bb5dc9c2-e638-4900-b4cd-80a294add3e7 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:23.136661 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bb5dc9c2-e638-4900-b4cd-80a294add3e7 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:23.137103 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bb5dc9c2-e638-4900-b4cd-80a294add3e7 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:23.137819 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bb5dc9c2-e638-4900-b4cd-80a294add3e7 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:23.138272 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bb5dc9c2-e638-4900-b4cd-80a294add3e7 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:23.138694 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bb5dc9c2-e638-4900-b4cd-80a294add3e7 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:23.305391 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-bb5dc9c2-e638-4900-b4cd-80a294add3e7 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:23.312956 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-bb5dc9c2-e638-4900-b4cd-80a294add3e7 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1674 microversion: 2.1 time: 0.187776 Aug 10 13:41:23.313625 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 231/487] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:23 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1674 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:41:23.505273 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-972a380d-280d-49fb-92a7-d6e5ee2c21cc tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:23.506475 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-972a380d-280d-49fb-92a7-d6e5ee2c21cc tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:23.512667 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-972a380d-280d-49fb-92a7-d6e5ee2c21cc tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:23.513146 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-972a380d-280d-49fb-92a7-d6e5ee2c21cc tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:23.513612 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-972a380d-280d-49fb-92a7-d6e5ee2c21cc tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:23.515272 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-972a380d-280d-49fb-92a7-d6e5ee2c21cc tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:23.515272 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-972a380d-280d-49fb-92a7-d6e5ee2c21cc tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:23.515272 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-972a380d-280d-49fb-92a7-d6e5ee2c21cc tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:23.742380 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-972a380d-280d-49fb-92a7-d6e5ee2c21cc tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:23.750449 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-972a380d-280d-49fb-92a7-d6e5ee2c21cc tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1735 microversion: 2.1 time: 0.250463 Aug 10 13:41:23.751216 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 257/488] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:23 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1735 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:24.334706 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-5da3832f-4261-49bb-b0e7-5b35d0b2cdf6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1929413921", "imageRef": "096d81df-12b1-4175-b914-babe0fa931c6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a2798d25-3b5d-43fb-8ba3-2bd216907bcd"}], "security_groups": [{"name": "tempest-securitygroup--186967121"}], "key_name": "tempest-keypair-1512207296", "user_data": "}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:41:24.335298 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-695067fc-1695-40d0-9b7f-6db59f60c485 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:24.335910 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-695067fc-1695-40d0-9b7f-6db59f60c485 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:24.341942 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-695067fc-1695-40d0-9b7f-6db59f60c485 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:24.342467 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-695067fc-1695-40d0-9b7f-6db59f60c485 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:24.342911 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-695067fc-1695-40d0-9b7f-6db59f60c485 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:24.343671 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-695067fc-1695-40d0-9b7f-6db59f60c485 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:24.344169 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-695067fc-1695-40d0-9b7f-6db59f60c485 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:24.344539 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-695067fc-1695-40d0-9b7f-6db59f60c485 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:24.449900 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.network.neutron [None req-5da3832f-4261-49bb-b0e7-5b35d0b2cdf6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] validate_networks() for [('a2798d25-3b5d-43fb-8ba3-2bd216907bcd', None, None, None, None, None)] {{(pid=129523) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:41:24.480354 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-695067fc-1695-40d0-9b7f-6db59f60c485 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:24.488743 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-695067fc-1695-40d0-9b7f-6db59f60c485 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1674 microversion: 2.1 time: 0.157330 Aug 10 13:41:24.489336 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 258/489] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:24 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:41:24.772357 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-6eb11694-69c1-4198-bcc6-5f1057741a0d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:24.773000 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-6eb11694-69c1-4198-bcc6-5f1057741a0d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:24.779258 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6eb11694-69c1-4198-bcc6-5f1057741a0d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:24.779737 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6eb11694-69c1-4198-bcc6-5f1057741a0d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:24.780166 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6eb11694-69c1-4198-bcc6-5f1057741a0d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:24.780850 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6eb11694-69c1-4198-bcc6-5f1057741a0d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:24.781325 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6eb11694-69c1-4198-bcc6-5f1057741a0d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:24.781745 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6eb11694-69c1-4198-bcc6-5f1057741a0d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:24.817017 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-5da3832f-4261-49bb-b0e7-5b35d0b2cdf6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Flavor limits 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:41:24.817468 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-5da3832f-4261-49bb-b0e7-5b35d0b2cdf6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Image limits 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:41:24.817939 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-5da3832f-4261-49bb-b0e7-5b35d0b2cdf6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Flavor pref 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:41:24.818341 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-5da3832f-4261-49bb-b0e7-5b35d0b2cdf6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Image pref 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:41:24.818739 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-5da3832f-4261-49bb-b0e7-5b35d0b2cdf6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:41:24.827348 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5da3832f-4261-49bb-b0e7-5b35d0b2cdf6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:24.827819 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5da3832f-4261-49bb-b0e7-5b35d0b2cdf6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:24.828247 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5da3832f-4261-49bb-b0e7-5b35d0b2cdf6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:24.829626 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5da3832f-4261-49bb-b0e7-5b35d0b2cdf6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:24.830789 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5da3832f-4261-49bb-b0e7-5b35d0b2cdf6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:24.831202 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5da3832f-4261-49bb-b0e7-5b35d0b2cdf6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:24.847465 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-5da3832f-4261-49bb-b0e7-5b35d0b2cdf6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Getting quotas for project 48e5556cbbfd4b00aa4f6055cd6238b2. Resources: {'cores', 'ram', 'instances'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:41:24.851578 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-5da3832f-4261-49bb-b0e7-5b35d0b2cdf6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Getting quotas for user a3d9e5dc719c430eac6b5c8d8b814566 and project 48e5556cbbfd4b00aa4f6055cd6238b2. Resources: {'cores', 'ram', 'instances'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:41:24.862557 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-5da3832f-4261-49bb-b0e7-5b35d0b2cdf6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Going to run 1 instances... {{(pid=129523) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:41:24.865028 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-5da3832f-4261-49bb-b0e7-5b35d0b2cdf6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: bfb52e6c-577e-4368-a03e-1be5e40b8e43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='096d81df-12b1-4175-b914-babe0fa931c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:41:24.910957 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-5da3832f-4261-49bb-b0e7-5b35d0b2cdf6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.581722 Aug 10 13:41:24.911921 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 232/490] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 10 13:41:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 13:41:24.915634 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-6eb11694-69c1-4198-bcc6-5f1057741a0d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:24.922797 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-d1ac3887-8d06-4243-8a45-e08c2c77fe05 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:24.923447 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-d1ac3887-8d06-4243-8a45-e08c2c77fe05 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: bfb52e6c-577e-4368-a03e-1be5e40b8e43] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:24.923929 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-6eb11694-69c1-4198-bcc6-5f1057741a0d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1735 microversion: 2.1 time: 0.155290 Aug 10 13:41:24.924503 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 259/491] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:24 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:41:24.981959 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-d1ac3887-8d06-4243-8a45-e08c2c77fe05 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:24.989356 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-d1ac3887-8d06-4243-8a45-e08c2c77fe05 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43" status: 200 len: 1242 microversion: 2.1 time: 0.070518 Aug 10 13:41:24.989927 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 233/492] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:24 2022] GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43 => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:41:25.510562 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-33313ddd-d460-49d3-97d7-5556c57a90bd tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:25.511158 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-33313ddd-d460-49d3-97d7-5556c57a90bd tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:25.517181 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-33313ddd-d460-49d3-97d7-5556c57a90bd tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:25.518325 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-33313ddd-d460-49d3-97d7-5556c57a90bd tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:25.518765 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-33313ddd-d460-49d3-97d7-5556c57a90bd tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:25.519456 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-33313ddd-d460-49d3-97d7-5556c57a90bd tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:25.519911 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-33313ddd-d460-49d3-97d7-5556c57a90bd tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:25.520332 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-33313ddd-d460-49d3-97d7-5556c57a90bd tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:25.652169 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-33313ddd-d460-49d3-97d7-5556c57a90bd tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:25.660761 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-33313ddd-d460-49d3-97d7-5556c57a90bd tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1674 microversion: 2.1 time: 0.154083 Aug 10 13:41:25.661913 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 260/493] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:25 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:25.944839 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-7016d322-9274-4ed0-838f-eb36595cc49e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:25.946045 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-7016d322-9274-4ed0-838f-eb36595cc49e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:25.952132 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7016d322-9274-4ed0-838f-eb36595cc49e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:25.952637 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7016d322-9274-4ed0-838f-eb36595cc49e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:25.953105 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7016d322-9274-4ed0-838f-eb36595cc49e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:25.953948 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7016d322-9274-4ed0-838f-eb36595cc49e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:25.954589 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7016d322-9274-4ed0-838f-eb36595cc49e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:25.955535 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7016d322-9274-4ed0-838f-eb36595cc49e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:26.010172 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-9ae4f024-148b-4024-91a6-67eb033a1f0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:26.010886 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-9ae4f024-148b-4024-91a6-67eb033a1f0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: bfb52e6c-577e-4368-a03e-1be5e40b8e43] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:26.018090 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9ae4f024-148b-4024-91a6-67eb033a1f0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:26.018568 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9ae4f024-148b-4024-91a6-67eb033a1f0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:26.019283 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9ae4f024-148b-4024-91a6-67eb033a1f0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:26.020048 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9ae4f024-148b-4024-91a6-67eb033a1f0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:26.020502 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9ae4f024-148b-4024-91a6-67eb033a1f0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:26.021486 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9ae4f024-148b-4024-91a6-67eb033a1f0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:26.094438 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-9ae4f024-148b-4024-91a6-67eb033a1f0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:26.097310 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:41:26.104485 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-9ae4f024-148b-4024-91a6-67eb033a1f0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43" status: 200 len: 1300 microversion: 2.1 time: 0.098533 Aug 10 13:41:26.105059 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 261/494] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:26 2022] GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43 => generated 1300 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:26.150554 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-7016d322-9274-4ed0-838f-eb36595cc49e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:26.159693 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-7016d322-9274-4ed0-838f-eb36595cc49e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1735 microversion: 2.1 time: 0.218697 Aug 10 13:41:26.160268 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 234/495] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:25 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1735 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:26.686169 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-b297335d-e3b4-41d3-9352-0ec16434949d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:26.686884 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-b297335d-e3b4-41d3-9352-0ec16434949d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:26.698402 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b297335d-e3b4-41d3-9352-0ec16434949d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:26.698890 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b297335d-e3b4-41d3-9352-0ec16434949d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:26.699324 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b297335d-e3b4-41d3-9352-0ec16434949d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:26.700018 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b297335d-e3b4-41d3-9352-0ec16434949d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:26.700471 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b297335d-e3b4-41d3-9352-0ec16434949d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:26.701009 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b297335d-e3b4-41d3-9352-0ec16434949d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:26.848403 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-b297335d-e3b4-41d3-9352-0ec16434949d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:26.856430 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-b297335d-e3b4-41d3-9352-0ec16434949d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1674 microversion: 2.1 time: 0.176401 Aug 10 13:41:26.857012 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 262/496] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:26 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1674 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:27.126339 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-b3631f17-a29f-4a26-ab1b-36fc7ca0b1c6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:27.127915 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-b3631f17-a29f-4a26-ab1b-36fc7ca0b1c6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: bfb52e6c-577e-4368-a03e-1be5e40b8e43] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:27.134412 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b3631f17-a29f-4a26-ab1b-36fc7ca0b1c6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:27.134900 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b3631f17-a29f-4a26-ab1b-36fc7ca0b1c6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:27.135341 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b3631f17-a29f-4a26-ab1b-36fc7ca0b1c6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:27.136030 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b3631f17-a29f-4a26-ab1b-36fc7ca0b1c6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:27.136483 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b3631f17-a29f-4a26-ab1b-36fc7ca0b1c6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:27.136905 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b3631f17-a29f-4a26-ab1b-36fc7ca0b1c6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:27.181477 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-981f7b59-07a0-4f59-b7c4-300a8ed6f3e6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:27.182297 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-981f7b59-07a0-4f59-b7c4-300a8ed6f3e6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:27.192195 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-981f7b59-07a0-4f59-b7c4-300a8ed6f3e6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:27.192690 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-981f7b59-07a0-4f59-b7c4-300a8ed6f3e6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:27.193128 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-981f7b59-07a0-4f59-b7c4-300a8ed6f3e6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:27.193900 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-981f7b59-07a0-4f59-b7c4-300a8ed6f3e6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:27.194354 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-981f7b59-07a0-4f59-b7c4-300a8ed6f3e6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:27.194776 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-981f7b59-07a0-4f59-b7c4-300a8ed6f3e6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:27.327124 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-b3631f17-a29f-4a26-ab1b-36fc7ca0b1c6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:27.329770 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-981f7b59-07a0-4f59-b7c4-300a8ed6f3e6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:27.335435 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-b3631f17-a29f-4a26-ab1b-36fc7ca0b1c6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43" status: 200 len: 1367 microversion: 2.1 time: 0.213702 Aug 10 13:41:27.336021 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 235/497] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:27 2022] GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:27.339013 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-981f7b59-07a0-4f59-b7c4-300a8ed6f3e6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1735 microversion: 2.1 time: 0.161686 Aug 10 13:41:27.353094 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 263/498] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:27 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:41:27.376590 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-b0839795-f8b5-4dec-b4c5-238f38ab5ff6 req-9cc36b80-6aab-47f4-8977-4d181af0a5fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfb52e6c-577e-4368-a03e-1be5e40b8e43", "tag": "f7c32ace-7a87-4f81-b64d-8dcc4f7bf65d"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:41:27.389751 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-b0839795-f8b5-4dec-b4c5-238f38ab5ff6 req-9cc36b80-6aab-47f4-8977-4d181af0a5fa service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:27.391121 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-b0839795-f8b5-4dec-b4c5-238f38ab5ff6 req-9cc36b80-6aab-47f4-8977-4d181af0a5fa service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:27.391686 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-b0839795-f8b5-4dec-b4c5-238f38ab5ff6 req-9cc36b80-6aab-47f4-8977-4d181af0a5fa service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:27.409493 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-b0839795-f8b5-4dec-b4c5-238f38ab5ff6 req-9cc36b80-6aab-47f4-8977-4d181af0a5fa service nova] Creating event network-changed:f7c32ace-7a87-4f81-b64d-8dcc4f7bf65d for instance bfb52e6c-577e-4368-a03e-1be5e40b8e43 on hv-cinder-85200 Aug 10 13:41:27.414640 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-b0839795-f8b5-4dec-b4c5-238f38ab5ff6 req-9cc36b80-6aab-47f4-8977-4d181af0a5fa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041682 Aug 10 13:41:27.415729 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 236/499] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:41:27.879224 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-74d8a466-87d7-4499-8e6c-adcd3d412817 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:27.879839 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-74d8a466-87d7-4499-8e6c-adcd3d412817 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:27.885847 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-74d8a466-87d7-4499-8e6c-adcd3d412817 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:27.886327 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-74d8a466-87d7-4499-8e6c-adcd3d412817 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:27.886761 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-74d8a466-87d7-4499-8e6c-adcd3d412817 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:27.887454 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-74d8a466-87d7-4499-8e6c-adcd3d412817 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:27.887909 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-74d8a466-87d7-4499-8e6c-adcd3d412817 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:27.888332 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-74d8a466-87d7-4499-8e6c-adcd3d412817 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:28.018186 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-74d8a466-87d7-4499-8e6c-adcd3d412817 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:28.025587 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-74d8a466-87d7-4499-8e6c-adcd3d412817 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1674 microversion: 2.1 time: 0.151492 Aug 10 13:41:28.026153 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 264/500] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:27 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:28.356387 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-0fb8ad64-06a1-4191-96e5-62553410d588 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:28.357107 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-0fb8ad64-06a1-4191-96e5-62553410d588 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: bfb52e6c-577e-4368-a03e-1be5e40b8e43] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:28.358887 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-1d7c9d65-fd5c-4e11-8838-8ed2743bd6c6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:28.359506 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-1d7c9d65-fd5c-4e11-8838-8ed2743bd6c6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:28.364436 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0fb8ad64-06a1-4191-96e5-62553410d588 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:28.364912 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0fb8ad64-06a1-4191-96e5-62553410d588 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:28.365361 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0fb8ad64-06a1-4191-96e5-62553410d588 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:28.366052 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0fb8ad64-06a1-4191-96e5-62553410d588 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:28.366496 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0fb8ad64-06a1-4191-96e5-62553410d588 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:28.366603 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1d7c9d65-fd5c-4e11-8838-8ed2743bd6c6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:28.366911 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0fb8ad64-06a1-4191-96e5-62553410d588 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:28.367016 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1d7c9d65-fd5c-4e11-8838-8ed2743bd6c6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:28.367412 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1d7c9d65-fd5c-4e11-8838-8ed2743bd6c6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:28.368784 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1d7c9d65-fd5c-4e11-8838-8ed2743bd6c6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:28.369261 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1d7c9d65-fd5c-4e11-8838-8ed2743bd6c6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:28.369689 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1d7c9d65-fd5c-4e11-8838-8ed2743bd6c6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:28.498112 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-1d7c9d65-fd5c-4e11-8838-8ed2743bd6c6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:28.498615 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-0fb8ad64-06a1-4191-96e5-62553410d588 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:28.506654 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-0fb8ad64-06a1-4191-96e5-62553410d588 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43" status: 200 len: 1367 microversion: 2.1 time: 0.154589 Aug 10 13:41:28.506833 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-1d7c9d65-fd5c-4e11-8838-8ed2743bd6c6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1735 microversion: 2.1 time: 0.151601 Aug 10 13:41:28.507231 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 237/502] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:28 2022] GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:28.507382 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 265/502] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:28 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:41:29.046659 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-c404dc2e-9968-453c-8e02-dd60bcbfaddb tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:29.047273 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-c404dc2e-9968-453c-8e02-dd60bcbfaddb tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:29.053084 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c404dc2e-9968-453c-8e02-dd60bcbfaddb tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:29.053610 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c404dc2e-9968-453c-8e02-dd60bcbfaddb tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:29.054047 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c404dc2e-9968-453c-8e02-dd60bcbfaddb tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:29.054742 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c404dc2e-9968-453c-8e02-dd60bcbfaddb tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:29.055236 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c404dc2e-9968-453c-8e02-dd60bcbfaddb tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:29.055663 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c404dc2e-9968-453c-8e02-dd60bcbfaddb tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:29.182700 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-c404dc2e-9968-453c-8e02-dd60bcbfaddb tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:29.190255 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-c404dc2e-9968-453c-8e02-dd60bcbfaddb tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1674 microversion: 2.1 time: 0.147388 Aug 10 13:41:29.191001 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 266/503] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:29 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:29.528099 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-7c204ef1-dc24-4f4d-ad47-d234bb2c7ca4 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:29.528643 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-7c204ef1-dc24-4f4d-ad47-d234bb2c7ca4 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: bfb52e6c-577e-4368-a03e-1be5e40b8e43] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:29.529189 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-9c9f2656-0d8e-4dfe-9a7c-211b6ad0ea91 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:29.529836 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-9c9f2656-0d8e-4dfe-9a7c-211b6ad0ea91 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:29.535553 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7c204ef1-dc24-4f4d-ad47-d234bb2c7ca4 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:29.536034 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7c204ef1-dc24-4f4d-ad47-d234bb2c7ca4 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:29.536465 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7c204ef1-dc24-4f4d-ad47-d234bb2c7ca4 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:29.536580 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9c9f2656-0d8e-4dfe-9a7c-211b6ad0ea91 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:29.537029 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9c9f2656-0d8e-4dfe-9a7c-211b6ad0ea91 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:29.537153 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7c204ef1-dc24-4f4d-ad47-d234bb2c7ca4 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:29.537486 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9c9f2656-0d8e-4dfe-9a7c-211b6ad0ea91 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:29.537603 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7c204ef1-dc24-4f4d-ad47-d234bb2c7ca4 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:29.538004 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7c204ef1-dc24-4f4d-ad47-d234bb2c7ca4 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:29.538167 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9c9f2656-0d8e-4dfe-9a7c-211b6ad0ea91 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:29.538613 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9c9f2656-0d8e-4dfe-9a7c-211b6ad0ea91 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:29.539026 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9c9f2656-0d8e-4dfe-9a7c-211b6ad0ea91 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:29.675110 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-7c204ef1-dc24-4f4d-ad47-d234bb2c7ca4 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:29.675846 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-9c9f2656-0d8e-4dfe-9a7c-211b6ad0ea91 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:29.682616 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-7c204ef1-dc24-4f4d-ad47-d234bb2c7ca4 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43" status: 200 len: 1367 microversion: 2.1 time: 0.158937 Aug 10 13:41:29.683180 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 238/504] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:29 2022] GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:29.683963 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-9c9f2656-0d8e-4dfe-9a7c-211b6ad0ea91 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1735 microversion: 2.1 time: 0.158888 Aug 10 13:41:29.684592 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 267/505] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:29 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:41:30.211719 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-1bba64d8-0af1-46b6-9299-d4f5603f02e8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:30.212335 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-1bba64d8-0af1-46b6-9299-d4f5603f02e8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:30.218343 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1bba64d8-0af1-46b6-9299-d4f5603f02e8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:30.218825 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1bba64d8-0af1-46b6-9299-d4f5603f02e8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:30.219262 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1bba64d8-0af1-46b6-9299-d4f5603f02e8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:30.219944 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1bba64d8-0af1-46b6-9299-d4f5603f02e8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:30.220979 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1bba64d8-0af1-46b6-9299-d4f5603f02e8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:30.221444 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1bba64d8-0af1-46b6-9299-d4f5603f02e8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:30.225485 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:41:30.350242 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-1bba64d8-0af1-46b6-9299-d4f5603f02e8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:30.357695 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-1bba64d8-0af1-46b6-9299-d4f5603f02e8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1674 microversion: 2.1 time: 0.149733 Aug 10 13:41:30.358463 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 239/506] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:30 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:30.703715 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-55605472-5fd8-4cab-802f-c3af58ce6df7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:30.704345 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-55605472-5fd8-4cab-802f-c3af58ce6df7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: bfb52e6c-577e-4368-a03e-1be5e40b8e43] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:30.705018 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-97b3602e-b376-4a75-bd3d-56ff42b895dd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:30.705674 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-97b3602e-b376-4a75-bd3d-56ff42b895dd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:30.710827 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-55605472-5fd8-4cab-802f-c3af58ce6df7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:30.711311 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-55605472-5fd8-4cab-802f-c3af58ce6df7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:30.711747 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-55605472-5fd8-4cab-802f-c3af58ce6df7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:30.712180 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-97b3602e-b376-4a75-bd3d-56ff42b895dd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:30.712438 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-55605472-5fd8-4cab-802f-c3af58ce6df7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:30.712666 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-97b3602e-b376-4a75-bd3d-56ff42b895dd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:30.712893 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-55605472-5fd8-4cab-802f-c3af58ce6df7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:30.713102 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-97b3602e-b376-4a75-bd3d-56ff42b895dd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:30.713343 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-55605472-5fd8-4cab-802f-c3af58ce6df7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:30.713824 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-97b3602e-b376-4a75-bd3d-56ff42b895dd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:30.714278 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-97b3602e-b376-4a75-bd3d-56ff42b895dd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:30.714704 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-97b3602e-b376-4a75-bd3d-56ff42b895dd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:30.841495 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-55605472-5fd8-4cab-802f-c3af58ce6df7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:30.845907 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-97b3602e-b376-4a75-bd3d-56ff42b895dd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:30.849546 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-55605472-5fd8-4cab-802f-c3af58ce6df7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43" status: 200 len: 1367 microversion: 2.1 time: 0.149627 Aug 10 13:41:30.850117 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 268/507] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:30 2022] GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:41:30.853851 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-97b3602e-b376-4a75-bd3d-56ff42b895dd tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1735 microversion: 2.1 time: 0.152640 Aug 10 13:41:30.854396 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 240/508] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:30 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:31.379469 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-751573a7-9092-4fb6-9be8-74ea0280c6c8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:31.380083 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-751573a7-9092-4fb6-9be8-74ea0280c6c8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:31.386090 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-751573a7-9092-4fb6-9be8-74ea0280c6c8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:31.386569 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-751573a7-9092-4fb6-9be8-74ea0280c6c8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:31.386998 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-751573a7-9092-4fb6-9be8-74ea0280c6c8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:31.387680 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-751573a7-9092-4fb6-9be8-74ea0280c6c8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:31.388139 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-751573a7-9092-4fb6-9be8-74ea0280c6c8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:31.388557 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-751573a7-9092-4fb6-9be8-74ea0280c6c8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:31.515144 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-751573a7-9092-4fb6-9be8-74ea0280c6c8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:31.523056 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-751573a7-9092-4fb6-9be8-74ea0280c6c8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1674 microversion: 2.1 time: 0.147424 Aug 10 13:41:31.523624 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 269/509] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:31 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:31.872000 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-23bb9154-3129-42f4-8bc7-b5e8641377d7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:31.872922 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-23bb9154-3129-42f4-8bc7-b5e8641377d7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: bfb52e6c-577e-4368-a03e-1be5e40b8e43] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:31.875220 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-76f516d5-a5ef-43bc-8bc9-00d25e850340 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:31.876407 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-76f516d5-a5ef-43bc-8bc9-00d25e850340 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:31.881727 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-23bb9154-3129-42f4-8bc7-b5e8641377d7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:31.882229 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-23bb9154-3129-42f4-8bc7-b5e8641377d7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:31.882806 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-23bb9154-3129-42f4-8bc7-b5e8641377d7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:31.883524 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-23bb9154-3129-42f4-8bc7-b5e8641377d7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:31.883665 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-76f516d5-a5ef-43bc-8bc9-00d25e850340 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:31.883985 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-23bb9154-3129-42f4-8bc7-b5e8641377d7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:31.884442 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-23bb9154-3129-42f4-8bc7-b5e8641377d7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:31.884605 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-76f516d5-a5ef-43bc-8bc9-00d25e850340 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:31.885282 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-76f516d5-a5ef-43bc-8bc9-00d25e850340 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:31.885954 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-76f516d5-a5ef-43bc-8bc9-00d25e850340 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:31.886410 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-76f516d5-a5ef-43bc-8bc9-00d25e850340 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:31.886861 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-76f516d5-a5ef-43bc-8bc9-00d25e850340 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:32.032965 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-23bb9154-3129-42f4-8bc7-b5e8641377d7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:32.035271 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-76f516d5-a5ef-43bc-8bc9-00d25e850340 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:32.041042 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-23bb9154-3129-42f4-8bc7-b5e8641377d7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43" status: 200 len: 1367 microversion: 2.1 time: 0.173670 Aug 10 13:41:32.041640 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 241/510] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:31 2022] GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:32.043148 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-76f516d5-a5ef-43bc-8bc9-00d25e850340 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1735 microversion: 2.1 time: 0.172364 Aug 10 13:41:32.043702 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 270/511] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:31 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:32.045951 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-60adfa99-2a58-4704-826f-6534295df9e9 req-6373e8ab-f6f1-441c-aaee-ed19b6d50af4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfb52e6c-577e-4368-a03e-1be5e40b8e43", "name": "network-vif-plugged", "status": "completed", "tag": "f7c32ace-7a87-4f81-b64d-8dcc4f7bf65d"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:41:32.055200 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-60adfa99-2a58-4704-826f-6534295df9e9 req-6373e8ab-f6f1-441c-aaee-ed19b6d50af4 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:32.055587 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-60adfa99-2a58-4704-826f-6534295df9e9 req-6373e8ab-f6f1-441c-aaee-ed19b6d50af4 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:32.056007 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-60adfa99-2a58-4704-826f-6534295df9e9 req-6373e8ab-f6f1-441c-aaee-ed19b6d50af4 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:32.066396 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-60adfa99-2a58-4704-826f-6534295df9e9 req-6373e8ab-f6f1-441c-aaee-ed19b6d50af4 service nova] Creating event network-vif-plugged:f7c32ace-7a87-4f81-b64d-8dcc4f7bf65d for instance bfb52e6c-577e-4368-a03e-1be5e40b8e43 on hv-cinder-85200 Aug 10 13:41:32.071109 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-60adfa99-2a58-4704-826f-6534295df9e9 req-6373e8ab-f6f1-441c-aaee-ed19b6d50af4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028401 Aug 10 13:41:32.071774 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 242/512] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:41:32.543787 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-d16fd9f5-2d6d-44c3-964c-af4d4d961236 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:32.544400 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-d16fd9f5-2d6d-44c3-964c-af4d4d961236 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:32.552603 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d16fd9f5-2d6d-44c3-964c-af4d4d961236 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:32.553118 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d16fd9f5-2d6d-44c3-964c-af4d4d961236 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:32.553570 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d16fd9f5-2d6d-44c3-964c-af4d4d961236 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:32.554266 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d16fd9f5-2d6d-44c3-964c-af4d4d961236 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:32.554716 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d16fd9f5-2d6d-44c3-964c-af4d4d961236 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:32.555180 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d16fd9f5-2d6d-44c3-964c-af4d4d961236 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:32.693423 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-d16fd9f5-2d6d-44c3-964c-af4d4d961236 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:32.701085 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-d16fd9f5-2d6d-44c3-964c-af4d4d961236 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1651 microversion: 2.1 time: 0.161085 Aug 10 13:41:32.701695 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 271/513] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:32 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1651 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:32.722790 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-e211aaa7-f0dd-45a2-9122-7bd9c7133cb0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:41:32.729930 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e211aaa7-f0dd-45a2-9122-7bd9c7133cb0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:32.730201 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e211aaa7-f0dd-45a2-9122-7bd9c7133cb0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:32.730431 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e211aaa7-f0dd-45a2-9122-7bd9c7133cb0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:32.758690 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-e211aaa7-f0dd-45a2-9122-7bd9c7133cb0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Going to try to start instance {{(pid=129523) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 10 13:41:32.802069 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-e211aaa7-f0dd-45a2-9122-7bd9c7133cb0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "POST /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522/action" status: 202 len: 0 microversion: 2.1 time: 0.083936 Aug 10 13:41:32.802656 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 243/514] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 10 13:41:32 2022] POST /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:41:32.810624 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-f407df5a-90cd-4653-b1f7-dff164fc0b3f tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:32.811243 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-f407df5a-90cd-4653-b1f7-dff164fc0b3f tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:32.817869 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f407df5a-90cd-4653-b1f7-dff164fc0b3f tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:32.818348 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f407df5a-90cd-4653-b1f7-dff164fc0b3f tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:32.818779 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f407df5a-90cd-4653-b1f7-dff164fc0b3f tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:32.819468 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f407df5a-90cd-4653-b1f7-dff164fc0b3f tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:32.820246 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f407df5a-90cd-4653-b1f7-dff164fc0b3f tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:32.820385 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f407df5a-90cd-4653-b1f7-dff164fc0b3f tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:32.932029 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell0:SELECT=4 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:41:32.967724 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-f407df5a-90cd-4653-b1f7-dff164fc0b3f tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:32.980331 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-f407df5a-90cd-4653-b1f7-dff164fc0b3f tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1660 microversion: 2.1 time: 0.173343 Aug 10 13:41:32.981038 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 272/515] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:32 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1660 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:33.063813 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-0b3a9faf-595d-4e87-ae56-43f3f2c7602d tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:33.065334 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-0b3a9faf-595d-4e87-ae56-43f3f2c7602d tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: bfb52e6c-577e-4368-a03e-1be5e40b8e43] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:33.065722 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-51c0f3ae-4261-4ab5-9668-5af9ad405047 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:33.066498 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-51c0f3ae-4261-4ab5-9668-5af9ad405047 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:33.071573 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0b3a9faf-595d-4e87-ae56-43f3f2c7602d tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:33.072065 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0b3a9faf-595d-4e87-ae56-43f3f2c7602d tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:33.072498 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0b3a9faf-595d-4e87-ae56-43f3f2c7602d tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:33.072641 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-51c0f3ae-4261-4ab5-9668-5af9ad405047 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:33.073110 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-51c0f3ae-4261-4ab5-9668-5af9ad405047 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:33.073223 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0b3a9faf-595d-4e87-ae56-43f3f2c7602d tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:33.073582 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-51c0f3ae-4261-4ab5-9668-5af9ad405047 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:33.073729 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0b3a9faf-595d-4e87-ae56-43f3f2c7602d tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:33.074065 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0b3a9faf-595d-4e87-ae56-43f3f2c7602d tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:33.074281 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-51c0f3ae-4261-4ab5-9668-5af9ad405047 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:33.074735 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-51c0f3ae-4261-4ab5-9668-5af9ad405047 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:33.075158 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-51c0f3ae-4261-4ab5-9668-5af9ad405047 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:33.209197 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-51c0f3ae-4261-4ab5-9668-5af9ad405047 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:33.209406 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-0b3a9faf-595d-4e87-ae56-43f3f2c7602d tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:33.217032 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-0b3a9faf-595d-4e87-ae56-43f3f2c7602d tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43" status: 200 len: 1367 microversion: 2.1 time: 0.157997 Aug 10 13:41:33.217538 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-51c0f3ae-4261-4ab5-9668-5af9ad405047 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1715 microversion: 2.1 time: 0.157228 Aug 10 13:41:33.217645 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 244/516] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:33 2022] GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:41:33.218190 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 273/517] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:33 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1715 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:41:33.338525 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-8fc7dfcb-ff03-445d-ae86-88ac764255fb tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:33.339246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-8fc7dfcb-ff03-445d-ae86-88ac764255fb tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:33.345958 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8fc7dfcb-ff03-445d-ae86-88ac764255fb tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:33.346461 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8fc7dfcb-ff03-445d-ae86-88ac764255fb tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:33.346903 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8fc7dfcb-ff03-445d-ae86-88ac764255fb tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:33.347645 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8fc7dfcb-ff03-445d-ae86-88ac764255fb tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:33.348131 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8fc7dfcb-ff03-445d-ae86-88ac764255fb tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:33.348561 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8fc7dfcb-ff03-445d-ae86-88ac764255fb tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:33.432336 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.wsgi [None req-8fc7dfcb-ff03-445d-ae86-88ac764255fb tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] HTTP exception thrown: Cannot 'detach_volume' instance 51cd434d-31c3-4588-aed7-48e7130c5131 while it is in vm_state rescued Aug 10 13:41:33.433994 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-8fc7dfcb-ff03-445d-ae86-88ac764255fb tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Request method failure captured: Aug 10 13:41:33.433994 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: request: DELETE /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131/os-volume_attachments/c17ef3e5-dc53-48b9-87cb-908c33ddad66 HTTP/1.1 Aug 10 13:41:33.433994 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept: application/json Aug 10 13:41:33.433994 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept-Encoding: identity Aug 10 13:41:33.433994 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Connection: close Aug 10 13:41:33.433994 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Length: 0 Aug 10 13:41:33.433994 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Type: application/json Aug 10 13:41:33.433994 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Host: 10.222.0.52 Aug 10 13:41:33.433994 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Openstack-System-Scope: None Aug 10 13:41:33.433994 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: User-Agent: python-urllib3/1.26.11 Aug 10 13:41:33.433994 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Auth-Token: gAAAAABi87SyiKkY4w5thpU-lMeFOv-pupV3M4p5O_G9Bq0nw7Mt72anXX_8NpPA6bSBk3F77efaTtx9_wfsx9tfpnDHinM6_nwESAvKYqiVuXh6I6GeGsfaWe_Ya10ueo8dBFFLc_3EiOnm1SU3tp8oyoyNzcvZhdKgk0BRE0yUrE4ibPeYstg Aug 10 13:41:33.433994 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Id: None Aug 10 13:41:33.433994 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Name: None Aug 10 13:41:33.433994 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Identity-Status: Confirmed Aug 10 13:41:33.433994 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Is-Admin-Project: True Aug 10 13:41:33.433994 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Id: default Aug 10 13:41:33.433994 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Name: Default Aug 10 13:41:33.433994 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Id: d8eda7c7d6a348e08e81a6b2496b09e5 Aug 10 13:41:33.433994 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2121919159 Aug 10 13:41:33.433994 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Role: member,reader Aug 10 13:41:33.433994 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Roles: member,reader Aug 10 13:41:33.435371 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d8eda7c7d6a348e08e81a6b2496b09e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d8eda7c7d6a348e08e81a6b2496b09e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d8eda7c7d6a348e08e81a6b2496b09e5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d8eda7c7d6a348e08e81a6b2496b09e5"}]}] Aug 10 13:41:33.435371 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2121919159 Aug 10 13:41:33.435371 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Id: d8eda7c7d6a348e08e81a6b2496b09e5 Aug 10 13:41:33.435371 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2121919159 Aug 10 13:41:33.435371 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User: tempest-ServerRescueNegativeTestJSON-2121919159-project Aug 10 13:41:33.435371 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Id: default Aug 10 13:41:33.435371 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Name: Default Aug 10 13:41:33.435371 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Id: 5573338f0bd64c729c7d89345069ca6f Aug 10 13:41:33.435371 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2121919159-project Aug 10 13:41:33.435371 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: method: > Aug 10 13:41:33.435371 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: exception: Cannot 'detach_volume' instance 51cd434d-31c3-4588-aed7-48e7130c5131 while it is in vm_state rescued Aug 10 13:41:33.436061 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: action_args: {'server_id': '51cd434d-31c3-4588-aed7-48e7130c5131', 'id': 'c17ef3e5-dc53-48b9-87cb-908c33ddad66'} Aug 10 13:41:33.436061 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:41:33.436061 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:41:33.436061 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 10 13:41:33.436061 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 10 13:41:33.436061 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 13:41:33.436061 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 13:41:33.436061 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 10 13:41:33.436061 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 13:41:33.436061 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 51cd434d-31c3-4588-aed7-48e7130c5131 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 10 13:41:33.436061 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:41:33.436061 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:41:33.436061 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:41:33.436061 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:41:33.436061 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:41:33.436061 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:41:33.436061 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:41:33.436061 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:41:33.436061 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:41:33.436061 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:41:33.437342 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 10 13:41:33.437342 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 10 13:41:33.437342 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 13:41:33.437342 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 13:41:33.437342 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 51cd434d-31c3-4588-aed7-48e7130c5131 while it is in vm_state rescued Aug 10 13:41:33.437342 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:41:33.437342 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:41:33.437342 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:41:33.437342 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:41:33.437342 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:41:33.437342 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:41:33.437342 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:41:33.437342 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:41:33.437342 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 51cd434d-31c3-4588-aed7-48e7130c5131 while it is in vm_state rescued Aug 10 13:41:33.437342 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:41:33.437342 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-8fc7dfcb-ff03-445d-ae86-88ac764255fb tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Returning 409 to user: Cannot 'detach_volume' instance 51cd434d-31c3-4588-aed7-48e7130c5131 while it is in vm_state rescued {{(pid=129523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:41:33.438327 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-8fc7dfcb-ff03-445d-ae86-88ac764255fb tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "DELETE /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131/os-volume_attachments/c17ef3e5-dc53-48b9-87cb-908c33ddad66" status: 409 len: 152 microversion: 2.1 time: 0.101403 Aug 10 13:41:33.438327 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 245/518] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Aug 10 13:41:33 2022] DELETE /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131/os-volume_attachments/c17ef3e5-dc53-48b9-87cb-908c33ddad66 => generated 152 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 10 13:41:33.445272 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-4e3db68b-d2e7-44aa-8cfc-0203355d24d9 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:41:33.445813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-4e3db68b-d2e7-44aa-8cfc-0203355d24d9 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:33.451784 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4e3db68b-d2e7-44aa-8cfc-0203355d24d9 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:33.452267 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4e3db68b-d2e7-44aa-8cfc-0203355d24d9 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:33.452699 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4e3db68b-d2e7-44aa-8cfc-0203355d24d9 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:33.453450 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4e3db68b-d2e7-44aa-8cfc-0203355d24d9 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:33.453911 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4e3db68b-d2e7-44aa-8cfc-0203355d24d9 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:33.454333 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4e3db68b-d2e7-44aa-8cfc-0203355d24d9 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:33.519781 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-4e3db68b-d2e7-44aa-8cfc-0203355d24d9 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "POST /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131/action" status: 202 len: 0 microversion: 2.1 time: 0.078345 Aug 10 13:41:33.520435 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 274/519] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 10 13:41:33 2022] POST /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:41:33.528796 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-3528bec9-5894-4ea6-9061-aefe137b04b1 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:33.529448 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-3528bec9-5894-4ea6-9061-aefe137b04b1 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:33.535799 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3528bec9-5894-4ea6-9061-aefe137b04b1 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:33.536292 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3528bec9-5894-4ea6-9061-aefe137b04b1 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:33.536733 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3528bec9-5894-4ea6-9061-aefe137b04b1 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:33.537459 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3528bec9-5894-4ea6-9061-aefe137b04b1 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:33.537917 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3528bec9-5894-4ea6-9061-aefe137b04b1 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:33.538342 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3528bec9-5894-4ea6-9061-aefe137b04b1 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:33.667685 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-3528bec9-5894-4ea6-9061-aefe137b04b1 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:33.676298 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-3528bec9-5894-4ea6-9061-aefe137b04b1 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1723 microversion: 2.1 time: 0.151315 Aug 10 13:41:33.676856 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 246/520] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:33 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:34.006931 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-73a67923-7c35-46c2-9491-bf318f0f87fe tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:34.007708 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-73a67923-7c35-46c2-9491-bf318f0f87fe tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:34.014631 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-73a67923-7c35-46c2-9491-bf318f0f87fe tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:34.015214 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-73a67923-7c35-46c2-9491-bf318f0f87fe tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:34.015721 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-73a67923-7c35-46c2-9491-bf318f0f87fe tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:34.016486 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-73a67923-7c35-46c2-9491-bf318f0f87fe tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:34.017010 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-73a67923-7c35-46c2-9491-bf318f0f87fe tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:34.018230 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-73a67923-7c35-46c2-9491-bf318f0f87fe tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:34.204567 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-73a67923-7c35-46c2-9491-bf318f0f87fe tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:34.212205 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-73a67923-7c35-46c2-9491-bf318f0f87fe tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1660 microversion: 2.1 time: 0.210532 Aug 10 13:41:34.212775 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 275/521] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:34 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1660 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:34.238204 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-3795fdc3-5883-4146-bcdf-2c25c59a9be9 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:34.238811 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-3795fdc3-5883-4146-bcdf-2c25c59a9be9 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: bfb52e6c-577e-4368-a03e-1be5e40b8e43] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:34.245214 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3795fdc3-5883-4146-bcdf-2c25c59a9be9 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:34.245723 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3795fdc3-5883-4146-bcdf-2c25c59a9be9 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:34.246157 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3795fdc3-5883-4146-bcdf-2c25c59a9be9 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:34.246836 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3795fdc3-5883-4146-bcdf-2c25c59a9be9 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:34.247284 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3795fdc3-5883-4146-bcdf-2c25c59a9be9 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:34.247697 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3795fdc3-5883-4146-bcdf-2c25c59a9be9 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:34.376232 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-3795fdc3-5883-4146-bcdf-2c25c59a9be9 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:34.385171 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-3795fdc3-5883-4146-bcdf-2c25c59a9be9 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43" status: 200 len: 1367 microversion: 2.1 time: 0.151454 Aug 10 13:41:34.385784 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 247/522] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:34 2022] GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:34.699788 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-6a91cbd4-f84d-4894-a569-5648c84a34b6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:34.700703 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-6a91cbd4-f84d-4894-a569-5648c84a34b6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:34.707534 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6a91cbd4-f84d-4894-a569-5648c84a34b6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:34.708587 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6a91cbd4-f84d-4894-a569-5648c84a34b6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:34.709643 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6a91cbd4-f84d-4894-a569-5648c84a34b6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:34.711116 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6a91cbd4-f84d-4894-a569-5648c84a34b6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:34.711770 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6a91cbd4-f84d-4894-a569-5648c84a34b6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:34.712505 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6a91cbd4-f84d-4894-a569-5648c84a34b6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:34.955360 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-6a91cbd4-f84d-4894-a569-5648c84a34b6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:34.963591 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-6a91cbd4-f84d-4894-a569-5648c84a34b6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1723 microversion: 2.1 time: 0.268636 Aug 10 13:41:34.964172 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 276/523] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:34 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1723 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:35.233184 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-50d54dfa-f622-4024-8a6b-b3c10df6b504 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:35.233824 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-50d54dfa-f622-4024-8a6b-b3c10df6b504 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:35.236287 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell0:SELECT=2 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:41:35.237114 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell0:SELECT=8 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:41:35.243628 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-50d54dfa-f622-4024-8a6b-b3c10df6b504 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:35.244236 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-50d54dfa-f622-4024-8a6b-b3c10df6b504 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:35.244538 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-50d54dfa-f622-4024-8a6b-b3c10df6b504 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:35.245254 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-50d54dfa-f622-4024-8a6b-b3c10df6b504 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:35.245730 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-50d54dfa-f622-4024-8a6b-b3c10df6b504 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:35.246159 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-50d54dfa-f622-4024-8a6b-b3c10df6b504 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:35.376867 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-50d54dfa-f622-4024-8a6b-b3c10df6b504 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:35.384846 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-50d54dfa-f622-4024-8a6b-b3c10df6b504 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1660 microversion: 2.1 time: 0.155443 Aug 10 13:41:35.385448 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 248/524] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:35 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1660 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:35.405914 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-2e78ffee-25be-450c-9d7e-26d9239f4659 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:35.406545 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-2e78ffee-25be-450c-9d7e-26d9239f4659 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: bfb52e6c-577e-4368-a03e-1be5e40b8e43] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:35.409560 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:41:35.415830 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2e78ffee-25be-450c-9d7e-26d9239f4659 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:35.416381 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2e78ffee-25be-450c-9d7e-26d9239f4659 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:35.416834 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2e78ffee-25be-450c-9d7e-26d9239f4659 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:35.417554 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2e78ffee-25be-450c-9d7e-26d9239f4659 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:35.418157 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2e78ffee-25be-450c-9d7e-26d9239f4659 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:35.418576 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2e78ffee-25be-450c-9d7e-26d9239f4659 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:35.437911 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:41:35.557444 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-2e78ffee-25be-450c-9d7e-26d9239f4659 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:35.564835 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-2e78ffee-25be-450c-9d7e-26d9239f4659 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43" status: 200 len: 1558 microversion: 2.1 time: 0.162948 Aug 10 13:41:35.565442 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 277/525] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:35 2022] GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:35.585147 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-79a60dfd-3f44-4284-9a62-3632846287f2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:35.585675 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-79a60dfd-3f44-4284-9a62-3632846287f2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: bfb52e6c-577e-4368-a03e-1be5e40b8e43] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:35.591674 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-79a60dfd-3f44-4284-9a62-3632846287f2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:35.592173 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-79a60dfd-3f44-4284-9a62-3632846287f2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:35.592616 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-79a60dfd-3f44-4284-9a62-3632846287f2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:35.593340 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-79a60dfd-3f44-4284-9a62-3632846287f2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:35.593797 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-79a60dfd-3f44-4284-9a62-3632846287f2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:35.594220 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-79a60dfd-3f44-4284-9a62-3632846287f2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:35.675918 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-79a60dfd-3f44-4284-9a62-3632846287f2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094248 Aug 10 13:41:35.676520 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 249/526] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Aug 10 13:41:35 2022] GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:41:35.983949 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-f48a5fb6-cba8-4291-a7e7-bbcc145bc0ae tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:35.984668 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-f48a5fb6-cba8-4291-a7e7-bbcc145bc0ae tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:35.991002 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f48a5fb6-cba8-4291-a7e7-bbcc145bc0ae tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:35.991492 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f48a5fb6-cba8-4291-a7e7-bbcc145bc0ae tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:35.991926 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f48a5fb6-cba8-4291-a7e7-bbcc145bc0ae tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:35.992634 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f48a5fb6-cba8-4291-a7e7-bbcc145bc0ae tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:35.993087 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f48a5fb6-cba8-4291-a7e7-bbcc145bc0ae tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:35.993604 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f48a5fb6-cba8-4291-a7e7-bbcc145bc0ae tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:36.238369 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-f48a5fb6-cba8-4291-a7e7-bbcc145bc0ae tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:36.246459 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-f48a5fb6-cba8-4291-a7e7-bbcc145bc0ae tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1723 microversion: 2.1 time: 0.266363 Aug 10 13:41:36.247216 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 278/527] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:35 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1723 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:36.406616 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-1459ccb5-e1fb-459e-a26d-a9d8cd5077f4 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:36.407317 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-1459ccb5-e1fb-459e-a26d-a9d8cd5077f4 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:36.413861 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1459ccb5-e1fb-459e-a26d-a9d8cd5077f4 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:36.414311 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1459ccb5-e1fb-459e-a26d-a9d8cd5077f4 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:36.414768 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1459ccb5-e1fb-459e-a26d-a9d8cd5077f4 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:36.416000 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1459ccb5-e1fb-459e-a26d-a9d8cd5077f4 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:36.416116 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1459ccb5-e1fb-459e-a26d-a9d8cd5077f4 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:36.416495 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1459ccb5-e1fb-459e-a26d-a9d8cd5077f4 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:36.545777 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-1459ccb5-e1fb-459e-a26d-a9d8cd5077f4 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:36.553335 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-1459ccb5-e1fb-459e-a26d-a9d8cd5077f4 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1664 microversion: 2.1 time: 0.151141 Aug 10 13:41:36.553898 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 250/528] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:36 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1664 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:36.774026 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-bfd34d12-25f4-4c4f-b2dd-27a8f1672fe6 req-8b8d6180-32cc-4907-a737-d77dcaa6aa0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfb52e6c-577e-4368-a03e-1be5e40b8e43", "tag": "f7c32ace-7a87-4f81-b64d-8dcc4f7bf65d"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:41:36.784904 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-bfd34d12-25f4-4c4f-b2dd-27a8f1672fe6 req-8b8d6180-32cc-4907-a737-d77dcaa6aa0a service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:36.785421 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-bfd34d12-25f4-4c4f-b2dd-27a8f1672fe6 req-8b8d6180-32cc-4907-a737-d77dcaa6aa0a service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:36.785856 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-bfd34d12-25f4-4c4f-b2dd-27a8f1672fe6 req-8b8d6180-32cc-4907-a737-d77dcaa6aa0a service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:36.799122 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-bfd34d12-25f4-4c4f-b2dd-27a8f1672fe6 req-8b8d6180-32cc-4907-a737-d77dcaa6aa0a service nova] Creating event network-changed:f7c32ace-7a87-4f81-b64d-8dcc4f7bf65d for instance bfb52e6c-577e-4368-a03e-1be5e40b8e43 on hv-cinder-85200 Aug 10 13:41:36.804007 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-bfd34d12-25f4-4c4f-b2dd-27a8f1672fe6 req-8b8d6180-32cc-4907-a737-d77dcaa6aa0a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033564 Aug 10 13:41:36.804623 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 279/529] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:41:36.904062 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-73168e78-fd3a-4666-bc9c-e9e13cafdc0f tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:41:36.906501 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-73168e78-fd3a-4666-bc9c-e9e13cafdc0f tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:36.912749 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-73168e78-fd3a-4666-bc9c-e9e13cafdc0f tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:36.913288 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-73168e78-fd3a-4666-bc9c-e9e13cafdc0f tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:36.913752 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-73168e78-fd3a-4666-bc9c-e9e13cafdc0f tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:36.914474 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-73168e78-fd3a-4666-bc9c-e9e13cafdc0f tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:36.914929 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-73168e78-fd3a-4666-bc9c-e9e13cafdc0f tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:36.915399 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-73168e78-fd3a-4666-bc9c-e9e13cafdc0f tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:36.992134 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-73168e78-fd3a-4666-bc9c-e9e13cafdc0f tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "POST /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39/action" status: 202 len: 0 microversion: 2.1 time: 0.091982 Aug 10 13:41:36.993544 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 251/530] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 10 13:41:36 2022] POST /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:41:37.006104 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-163e5bda-1f6c-4117-812b-6da11f921093 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:37.007175 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-163e5bda-1f6c-4117-812b-6da11f921093 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:37.015097 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-163e5bda-1f6c-4117-812b-6da11f921093 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:37.015734 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-163e5bda-1f6c-4117-812b-6da11f921093 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:37.016199 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-163e5bda-1f6c-4117-812b-6da11f921093 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:37.016933 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-163e5bda-1f6c-4117-812b-6da11f921093 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:37.017999 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-163e5bda-1f6c-4117-812b-6da11f921093 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:37.018430 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-163e5bda-1f6c-4117-812b-6da11f921093 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:37.174350 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-163e5bda-1f6c-4117-812b-6da11f921093 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:37.183484 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-163e5bda-1f6c-4117-812b-6da11f921093 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1752 microversion: 2.1 time: 0.185302 Aug 10 13:41:37.184325 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 280/531] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:36 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1752 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:37.268775 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-868b8e90-ce15-491d-acda-b102f1e25685 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:37.269423 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-868b8e90-ce15-491d-acda-b102f1e25685 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:37.275714 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-868b8e90-ce15-491d-acda-b102f1e25685 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:37.276203 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-868b8e90-ce15-491d-acda-b102f1e25685 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:37.276641 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-868b8e90-ce15-491d-acda-b102f1e25685 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:37.277362 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-868b8e90-ce15-491d-acda-b102f1e25685 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:37.277822 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-868b8e90-ce15-491d-acda-b102f1e25685 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:37.278729 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-868b8e90-ce15-491d-acda-b102f1e25685 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:37.407151 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-868b8e90-ce15-491d-acda-b102f1e25685 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:37.415849 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-868b8e90-ce15-491d-acda-b102f1e25685 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1723 microversion: 2.1 time: 0.151665 Aug 10 13:41:37.416629 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 252/532] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:37 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:38.206478 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-cd6deebf-3fe6-4bcb-9932-b29ad46d692b tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:38.207116 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-cd6deebf-3fe6-4bcb-9932-b29ad46d692b tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:38.213953 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cd6deebf-3fe6-4bcb-9932-b29ad46d692b tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:38.214456 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cd6deebf-3fe6-4bcb-9932-b29ad46d692b tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:38.214873 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cd6deebf-3fe6-4bcb-9932-b29ad46d692b tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:38.215563 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cd6deebf-3fe6-4bcb-9932-b29ad46d692b tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:38.216015 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cd6deebf-3fe6-4bcb-9932-b29ad46d692b tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:38.216464 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cd6deebf-3fe6-4bcb-9932-b29ad46d692b tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:38.357185 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-cd6deebf-3fe6-4bcb-9932-b29ad46d692b tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:38.365347 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-cd6deebf-3fe6-4bcb-9932-b29ad46d692b tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1752 microversion: 2.1 time: 0.163206 Aug 10 13:41:38.365909 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 281/533] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:38 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:38.436988 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-b19d60e2-8c6e-4041-abc3-d2d6341451b4 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:38.437639 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-b19d60e2-8c6e-4041-abc3-d2d6341451b4 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:38.444431 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b19d60e2-8c6e-4041-abc3-d2d6341451b4 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:38.444915 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b19d60e2-8c6e-4041-abc3-d2d6341451b4 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:38.445382 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b19d60e2-8c6e-4041-abc3-d2d6341451b4 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:38.446066 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b19d60e2-8c6e-4041-abc3-d2d6341451b4 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:38.446518 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b19d60e2-8c6e-4041-abc3-d2d6341451b4 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:38.446946 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b19d60e2-8c6e-4041-abc3-d2d6341451b4 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:38.578456 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-b19d60e2-8c6e-4041-abc3-d2d6341451b4 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:38.587347 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-b19d60e2-8c6e-4041-abc3-d2d6341451b4 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1723 microversion: 2.1 time: 0.154125 Aug 10 13:41:38.587928 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 253/534] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:38 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:39.393113 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-1da51e3b-7fad-4e5b-909f-45fdcc0e01c0 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:39.393827 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-1da51e3b-7fad-4e5b-909f-45fdcc0e01c0 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:39.400992 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1da51e3b-7fad-4e5b-909f-45fdcc0e01c0 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:39.401513 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1da51e3b-7fad-4e5b-909f-45fdcc0e01c0 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:39.402159 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1da51e3b-7fad-4e5b-909f-45fdcc0e01c0 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:39.403022 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1da51e3b-7fad-4e5b-909f-45fdcc0e01c0 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:39.403481 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1da51e3b-7fad-4e5b-909f-45fdcc0e01c0 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:39.403903 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1da51e3b-7fad-4e5b-909f-45fdcc0e01c0 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:39.548614 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-1da51e3b-7fad-4e5b-909f-45fdcc0e01c0 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:39.557544 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-1da51e3b-7fad-4e5b-909f-45fdcc0e01c0 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1757 microversion: 2.1 time: 0.174006 Aug 10 13:41:39.557889 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 282/535] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:39 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:39.608995 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-25db9e78-23d1-40fd-83c3-926a7ec3a9ed tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:39.609676 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-25db9e78-23d1-40fd-83c3-926a7ec3a9ed tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:39.616870 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-25db9e78-23d1-40fd-83c3-926a7ec3a9ed tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:39.617380 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-25db9e78-23d1-40fd-83c3-926a7ec3a9ed tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:39.617813 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-25db9e78-23d1-40fd-83c3-926a7ec3a9ed tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:39.618502 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-25db9e78-23d1-40fd-83c3-926a7ec3a9ed tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:39.618946 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-25db9e78-23d1-40fd-83c3-926a7ec3a9ed tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:39.619383 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-25db9e78-23d1-40fd-83c3-926a7ec3a9ed tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:39.751075 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-25db9e78-23d1-40fd-83c3-926a7ec3a9ed tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:39.755139 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:41:39.760746 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-25db9e78-23d1-40fd-83c3-926a7ec3a9ed tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1729 microversion: 2.1 time: 0.155610 Aug 10 13:41:39.761351 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 254/536] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:39 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:39.781826 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-5c52d3ab-6b2d-4a6a-8a1c-5c2413ab389e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:39.782315 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-5c52d3ab-6b2d-4a6a-8a1c-5c2413ab389e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:39.788766 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5c52d3ab-6b2d-4a6a-8a1c-5c2413ab389e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:39.789344 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5c52d3ab-6b2d-4a6a-8a1c-5c2413ab389e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:39.789700 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5c52d3ab-6b2d-4a6a-8a1c-5c2413ab389e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:39.790419 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5c52d3ab-6b2d-4a6a-8a1c-5c2413ab389e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:39.790957 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5c52d3ab-6b2d-4a6a-8a1c-5c2413ab389e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:39.791291 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5c52d3ab-6b2d-4a6a-8a1c-5c2413ab389e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:39.873534 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-5c52d3ab-6b2d-4a6a-8a1c-5c2413ab389e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095754 Aug 10 13:41:39.874135 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 283/537] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Aug 10 13:41:39 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:41:40.580172 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-517e9b48-0d3a-4181-93b1-7a552a1e3a0e tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:40.580879 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-517e9b48-0d3a-4181-93b1-7a552a1e3a0e tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:40.588357 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-517e9b48-0d3a-4181-93b1-7a552a1e3a0e tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:40.588956 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-517e9b48-0d3a-4181-93b1-7a552a1e3a0e tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:40.589491 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-517e9b48-0d3a-4181-93b1-7a552a1e3a0e tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:40.590262 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-517e9b48-0d3a-4181-93b1-7a552a1e3a0e tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:40.590717 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-517e9b48-0d3a-4181-93b1-7a552a1e3a0e tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:40.591137 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-517e9b48-0d3a-4181-93b1-7a552a1e3a0e tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:40.747016 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-517e9b48-0d3a-4181-93b1-7a552a1e3a0e tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:40.756250 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-517e9b48-0d3a-4181-93b1-7a552a1e3a0e tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1757 microversion: 2.1 time: 0.180524 Aug 10 13:41:40.756843 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 255/538] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:40 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:41:40.995795 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-375e7e3c-b054-4c73-a390-033ef8aaf469 req-458d9fe3-b7a7-4f0f-86ab-f53bfb700b75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51cd434d-31c3-4588-aed7-48e7130c5131", "tag": "514f1eb9-5330-47e3-b4c5-db965c497335"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:41:40.999888 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-375e7e3c-b054-4c73-a390-033ef8aaf469 req-458d9fe3-b7a7-4f0f-86ab-f53bfb700b75 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:41.000313 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-375e7e3c-b054-4c73-a390-033ef8aaf469 req-458d9fe3-b7a7-4f0f-86ab-f53bfb700b75 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:41.000851 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-375e7e3c-b054-4c73-a390-033ef8aaf469 req-458d9fe3-b7a7-4f0f-86ab-f53bfb700b75 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:41.012523 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-375e7e3c-b054-4c73-a390-033ef8aaf469 req-458d9fe3-b7a7-4f0f-86ab-f53bfb700b75 service nova] Creating event network-changed:514f1eb9-5330-47e3-b4c5-db965c497335 for instance 51cd434d-31c3-4588-aed7-48e7130c5131 on hv-cinder-85200 Aug 10 13:41:41.018655 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-375e7e3c-b054-4c73-a390-033ef8aaf469 req-458d9fe3-b7a7-4f0f-86ab-f53bfb700b75 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033974 Aug 10 13:41:41.019390 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 284/539] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:41:41.778580 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-3e39c7ff-5cf8-4e2f-b800-eb3b525390d1 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:41.779538 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-3e39c7ff-5cf8-4e2f-b800-eb3b525390d1 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:41.787174 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3e39c7ff-5cf8-4e2f-b800-eb3b525390d1 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:41.787749 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3e39c7ff-5cf8-4e2f-b800-eb3b525390d1 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:41.788396 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3e39c7ff-5cf8-4e2f-b800-eb3b525390d1 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:41.789511 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3e39c7ff-5cf8-4e2f-b800-eb3b525390d1 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:41.790357 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3e39c7ff-5cf8-4e2f-b800-eb3b525390d1 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:41.790983 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3e39c7ff-5cf8-4e2f-b800-eb3b525390d1 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:41.956138 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-3e39c7ff-5cf8-4e2f-b800-eb3b525390d1 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:41.964567 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-3e39c7ff-5cf8-4e2f-b800-eb3b525390d1 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1757 microversion: 2.1 time: 0.190028 Aug 10 13:41:41.965618 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 256/540] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:41 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1757 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:42.989067 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-afede261-5373-47cf-9eea-52355edd894d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:42.989933 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-afede261-5373-47cf-9eea-52355edd894d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:42.996799 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-afede261-5373-47cf-9eea-52355edd894d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:42.997499 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-afede261-5373-47cf-9eea-52355edd894d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:42.997999 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-afede261-5373-47cf-9eea-52355edd894d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:42.998837 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-afede261-5373-47cf-9eea-52355edd894d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:42.999296 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-afede261-5373-47cf-9eea-52355edd894d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:43.000296 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-afede261-5373-47cf-9eea-52355edd894d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:43.034009 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-72f1ffad-3e69-44ee-b475-355958e8bc48 req-c0108420-7810-42e0-88a9-ef1ef5956680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51cd434d-31c3-4588-aed7-48e7130c5131", "tag": "514f1eb9-5330-47e3-b4c5-db965c497335"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:41:43.044673 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-72f1ffad-3e69-44ee-b475-355958e8bc48 req-c0108420-7810-42e0-88a9-ef1ef5956680 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:43.045161 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-72f1ffad-3e69-44ee-b475-355958e8bc48 req-c0108420-7810-42e0-88a9-ef1ef5956680 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:43.045610 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-72f1ffad-3e69-44ee-b475-355958e8bc48 req-c0108420-7810-42e0-88a9-ef1ef5956680 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:43.057425 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-72f1ffad-3e69-44ee-b475-355958e8bc48 req-c0108420-7810-42e0-88a9-ef1ef5956680 service nova] Creating event network-changed:514f1eb9-5330-47e3-b4c5-db965c497335 for instance 51cd434d-31c3-4588-aed7-48e7130c5131 on hv-cinder-85200 Aug 10 13:41:43.062439 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-72f1ffad-3e69-44ee-b475-355958e8bc48 req-c0108420-7810-42e0-88a9-ef1ef5956680 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032684 Aug 10 13:41:43.063038 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 257/541] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:41:43.149221 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-afede261-5373-47cf-9eea-52355edd894d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:43.157206 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-afede261-5373-47cf-9eea-52355edd894d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1757 microversion: 2.1 time: 0.174083 Aug 10 13:41:43.157793 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 285/542] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:42 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:44.179052 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-e27058f5-f013-4476-91d5-cb2555c379d6 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:44.179748 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-e27058f5-f013-4476-91d5-cb2555c379d6 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:44.185959 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e27058f5-f013-4476-91d5-cb2555c379d6 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:44.186445 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e27058f5-f013-4476-91d5-cb2555c379d6 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:44.186888 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e27058f5-f013-4476-91d5-cb2555c379d6 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:44.187585 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e27058f5-f013-4476-91d5-cb2555c379d6 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:44.188036 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e27058f5-f013-4476-91d5-cb2555c379d6 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:44.188472 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e27058f5-f013-4476-91d5-cb2555c379d6 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:44.347631 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-e27058f5-f013-4476-91d5-cb2555c379d6 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:44.356284 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-e27058f5-f013-4476-91d5-cb2555c379d6 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1757 microversion: 2.1 time: 0.181893 Aug 10 13:41:44.356852 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 258/543] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:44 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:45.378396 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-cd1bb7e2-f49a-4d52-a134-71061d061b8d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:45.379069 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-cd1bb7e2-f49a-4d52-a134-71061d061b8d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:45.385853 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cd1bb7e2-f49a-4d52-a134-71061d061b8d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:45.386325 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cd1bb7e2-f49a-4d52-a134-71061d061b8d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:45.386760 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cd1bb7e2-f49a-4d52-a134-71061d061b8d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:45.387448 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cd1bb7e2-f49a-4d52-a134-71061d061b8d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:45.387894 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cd1bb7e2-f49a-4d52-a134-71061d061b8d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:45.388308 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cd1bb7e2-f49a-4d52-a134-71061d061b8d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:45.536929 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-cd1bb7e2-f49a-4d52-a134-71061d061b8d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:45.545130 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-cd1bb7e2-f49a-4d52-a134-71061d061b8d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1757 microversion: 2.1 time: 0.171122 Aug 10 13:41:45.545738 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 286/544] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:45 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:46.567626 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-4e49dab5-29ca-42c2-8ebc-2e8893efd24a tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:46.568188 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-4e49dab5-29ca-42c2-8ebc-2e8893efd24a tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:46.570785 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:41:46.576379 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4e49dab5-29ca-42c2-8ebc-2e8893efd24a tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:46.576888 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4e49dab5-29ca-42c2-8ebc-2e8893efd24a tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:46.577369 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4e49dab5-29ca-42c2-8ebc-2e8893efd24a tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:46.578102 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4e49dab5-29ca-42c2-8ebc-2e8893efd24a tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:46.578559 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4e49dab5-29ca-42c2-8ebc-2e8893efd24a tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:46.578983 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4e49dab5-29ca-42c2-8ebc-2e8893efd24a tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:46.723627 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-4e49dab5-29ca-42c2-8ebc-2e8893efd24a tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:46.731938 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-4e49dab5-29ca-42c2-8ebc-2e8893efd24a tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1757 microversion: 2.1 time: 0.168260 Aug 10 13:41:46.732510 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 259/545] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:46 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:47.754594 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-1716383f-d77a-427c-a000-efd53a2e4e70 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:47.755233 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-1716383f-d77a-427c-a000-efd53a2e4e70 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:47.761720 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1716383f-d77a-427c-a000-efd53a2e4e70 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:47.762205 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1716383f-d77a-427c-a000-efd53a2e4e70 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:47.762633 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1716383f-d77a-427c-a000-efd53a2e4e70 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:47.763326 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1716383f-d77a-427c-a000-efd53a2e4e70 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:47.763775 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1716383f-d77a-427c-a000-efd53a2e4e70 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:47.764197 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1716383f-d77a-427c-a000-efd53a2e4e70 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:47.908902 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-1716383f-d77a-427c-a000-efd53a2e4e70 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:47.916766 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-1716383f-d77a-427c-a000-efd53a2e4e70 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1757 microversion: 2.1 time: 0.166602 Aug 10 13:41:47.917356 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 287/546] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:47 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:48.939806 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-7b66b31d-c445-4bd3-827f-1fc416ca97b7 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:48.940399 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-7b66b31d-c445-4bd3-827f-1fc416ca97b7 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:48.946992 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7b66b31d-c445-4bd3-827f-1fc416ca97b7 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:48.947495 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7b66b31d-c445-4bd3-827f-1fc416ca97b7 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:48.947924 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7b66b31d-c445-4bd3-827f-1fc416ca97b7 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:48.948600 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7b66b31d-c445-4bd3-827f-1fc416ca97b7 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:48.949048 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7b66b31d-c445-4bd3-827f-1fc416ca97b7 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:48.949507 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7b66b31d-c445-4bd3-827f-1fc416ca97b7 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:49.091857 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-7b66b31d-c445-4bd3-827f-1fc416ca97b7 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:49.100162 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-7b66b31d-c445-4bd3-827f-1fc416ca97b7 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1757 microversion: 2.1 time: 0.165282 Aug 10 13:41:49.100729 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 260/547] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:48 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:50.122707 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-360bc5af-34dd-4955-af9e-7c746a325207 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:50.123300 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-360bc5af-34dd-4955-af9e-7c746a325207 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:50.129890 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-360bc5af-34dd-4955-af9e-7c746a325207 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:50.130365 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-360bc5af-34dd-4955-af9e-7c746a325207 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:50.130791 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-360bc5af-34dd-4955-af9e-7c746a325207 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:50.131466 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-360bc5af-34dd-4955-af9e-7c746a325207 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:50.131910 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-360bc5af-34dd-4955-af9e-7c746a325207 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:50.132321 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-360bc5af-34dd-4955-af9e-7c746a325207 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:50.276238 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-360bc5af-34dd-4955-af9e-7c746a325207 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:50.285218 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-360bc5af-34dd-4955-af9e-7c746a325207 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1757 microversion: 2.1 time: 0.166488 Aug 10 13:41:50.285819 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 288/548] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:50 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:51.307266 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-db9e1f3c-ee85-484c-9b95-48f9c4181ce3 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:51.307905 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-db9e1f3c-ee85-484c-9b95-48f9c4181ce3 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:51.314393 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-db9e1f3c-ee85-484c-9b95-48f9c4181ce3 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:51.314881 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-db9e1f3c-ee85-484c-9b95-48f9c4181ce3 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:51.315313 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-db9e1f3c-ee85-484c-9b95-48f9c4181ce3 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:51.316013 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-db9e1f3c-ee85-484c-9b95-48f9c4181ce3 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:51.316461 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-db9e1f3c-ee85-484c-9b95-48f9c4181ce3 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:51.316882 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-db9e1f3c-ee85-484c-9b95-48f9c4181ce3 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:51.460150 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-db9e1f3c-ee85-484c-9b95-48f9c4181ce3 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:51.468184 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-db9e1f3c-ee85-484c-9b95-48f9c4181ce3 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1757 microversion: 2.1 time: 0.164863 Aug 10 13:41:51.468797 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 261/549] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:51 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:52.489961 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-996f117e-e571-4b34-811d-a41e15c4c2dc tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:52.490573 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-996f117e-e571-4b34-811d-a41e15c4c2dc tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:52.497062 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-996f117e-e571-4b34-811d-a41e15c4c2dc tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:52.497569 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-996f117e-e571-4b34-811d-a41e15c4c2dc tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:52.498008 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-996f117e-e571-4b34-811d-a41e15c4c2dc tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:52.498695 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-996f117e-e571-4b34-811d-a41e15c4c2dc tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:52.499149 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-996f117e-e571-4b34-811d-a41e15c4c2dc tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:52.499569 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-996f117e-e571-4b34-811d-a41e15c4c2dc tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:52.649898 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-996f117e-e571-4b34-811d-a41e15c4c2dc tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:52.658199 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-996f117e-e571-4b34-811d-a41e15c4c2dc tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1757 microversion: 2.1 time: 0.172344 Aug 10 13:41:52.658766 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 289/550] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:52 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:53.679796 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-38aeda1f-d748-4eec-b020-d7093069192c tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:53.680416 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-38aeda1f-d748-4eec-b020-d7093069192c tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:53.686816 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-38aeda1f-d748-4eec-b020-d7093069192c tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:53.687335 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-38aeda1f-d748-4eec-b020-d7093069192c tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:53.687769 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-38aeda1f-d748-4eec-b020-d7093069192c tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:53.689203 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-38aeda1f-d748-4eec-b020-d7093069192c tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:53.689682 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-38aeda1f-d748-4eec-b020-d7093069192c tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:53.690105 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-38aeda1f-d748-4eec-b020-d7093069192c tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:53.835007 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-38aeda1f-d748-4eec-b020-d7093069192c tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:53.842905 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-38aeda1f-d748-4eec-b020-d7093069192c tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1757 microversion: 2.1 time: 0.167029 Aug 10 13:41:53.843467 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 262/551] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:53 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:54.865080 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-60ab5363-d122-4097-a17c-8b1ab6442a39 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:54.865709 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-60ab5363-d122-4097-a17c-8b1ab6442a39 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:54.872778 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-60ab5363-d122-4097-a17c-8b1ab6442a39 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:54.873281 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-60ab5363-d122-4097-a17c-8b1ab6442a39 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:54.873714 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-60ab5363-d122-4097-a17c-8b1ab6442a39 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:54.874406 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-60ab5363-d122-4097-a17c-8b1ab6442a39 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:54.874875 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-60ab5363-d122-4097-a17c-8b1ab6442a39 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:54.875382 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-60ab5363-d122-4097-a17c-8b1ab6442a39 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:55.025802 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-60ab5363-d122-4097-a17c-8b1ab6442a39 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:55.034403 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-60ab5363-d122-4097-a17c-8b1ab6442a39 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1757 microversion: 2.1 time: 0.174032 Aug 10 13:41:55.034966 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 290/552] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:54 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:56.056817 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-2b4488c3-f18e-4a07-860c-03d54d191bcc tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:56.057464 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-2b4488c3-f18e-4a07-860c-03d54d191bcc tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:56.064657 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2b4488c3-f18e-4a07-860c-03d54d191bcc tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:56.065132 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2b4488c3-f18e-4a07-860c-03d54d191bcc tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:56.065605 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2b4488c3-f18e-4a07-860c-03d54d191bcc tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:56.066274 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2b4488c3-f18e-4a07-860c-03d54d191bcc tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:56.066721 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2b4488c3-f18e-4a07-860c-03d54d191bcc tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:56.067139 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2b4488c3-f18e-4a07-860c-03d54d191bcc tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:56.210559 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-2b4488c3-f18e-4a07-860c-03d54d191bcc tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:56.218714 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-2b4488c3-f18e-4a07-860c-03d54d191bcc tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1757 microversion: 2.1 time: 0.166038 Aug 10 13:41:56.219284 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 263/553] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:56 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:57.240211 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-5d3bb058-6bfd-4b8b-b1bb-b89438b6d7cd tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:57.241199 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-5d3bb058-6bfd-4b8b-b1bb-b89438b6d7cd tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:57.247620 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5d3bb058-6bfd-4b8b-b1bb-b89438b6d7cd tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:57.248105 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5d3bb058-6bfd-4b8b-b1bb-b89438b6d7cd tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:57.248540 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5d3bb058-6bfd-4b8b-b1bb-b89438b6d7cd tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:57.249248 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5d3bb058-6bfd-4b8b-b1bb-b89438b6d7cd tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:57.249703 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5d3bb058-6bfd-4b8b-b1bb-b89438b6d7cd tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:57.250121 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5d3bb058-6bfd-4b8b-b1bb-b89438b6d7cd tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:57.413473 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-5d3bb058-6bfd-4b8b-b1bb-b89438b6d7cd tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:57.421766 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-5d3bb058-6bfd-4b8b-b1bb-b89438b6d7cd tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1757 microversion: 2.1 time: 0.185773 Aug 10 13:41:57.422560 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 291/554] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:57 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1757 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:57.999591 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-c418f5e2-bb99-419a-b367-611093e8aa33 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:58.000185 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-c418f5e2-bb99-419a-b367-611093e8aa33 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:58.007462 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c418f5e2-bb99-419a-b367-611093e8aa33 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:58.007943 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c418f5e2-bb99-419a-b367-611093e8aa33 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:58.008380 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c418f5e2-bb99-419a-b367-611093e8aa33 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:58.009060 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c418f5e2-bb99-419a-b367-611093e8aa33 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:58.009623 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c418f5e2-bb99-419a-b367-611093e8aa33 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:58.010043 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c418f5e2-bb99-419a-b367-611093e8aa33 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:58.037950 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-c418f5e2-bb99-419a-b367-611093e8aa33 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb/os-volume_attachments/11ea44ee-11b0-46db-b933-20dd4590413b" status: 200 len: 194 microversion: 2.20 time: 0.042337 Aug 10 13:41:58.038517 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 264/555] 10.222.0.52 () {60 vars in 1454 bytes} [Wed Aug 10 13:41:57 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb/os-volume_attachments/11ea44ee-11b0-46db-b933-20dd4590413b => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 13:41:58.105402 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-9025183a-184c-4ec0-9041-c6bc9286f68e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:58.105895 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-9025183a-184c-4ec0-9041-c6bc9286f68e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:58.111926 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9025183a-184c-4ec0-9041-c6bc9286f68e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:58.112398 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9025183a-184c-4ec0-9041-c6bc9286f68e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:58.113086 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9025183a-184c-4ec0-9041-c6bc9286f68e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:58.113812 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9025183a-184c-4ec0-9041-c6bc9286f68e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:58.114257 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9025183a-184c-4ec0-9041-c6bc9286f68e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:58.114672 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9025183a-184c-4ec0-9041-c6bc9286f68e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:58.195001 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.objects.instance [None req-9025183a-184c-4ec0-9041-c6bc9286f68e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lazy-loading 'services' on Instance uuid cdba9a34-3f3e-4314-a377-e6dc259c27cb {{(pid=129522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:41:58.265292 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-9025183a-184c-4ec0-9041-c6bc9286f68e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb/os-volume_attachments/11ea44ee-11b0-46db-b933-20dd4590413b" status: 202 len: 0 microversion: 2.20 time: 0.163627 Aug 10 13:41:58.266001 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 292/556] 10.222.0.52 () {60 vars in 1457 bytes} [Wed Aug 10 13:41:58 2022] DELETE /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb/os-volume_attachments/11ea44ee-11b0-46db-b933-20dd4590413b => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:41:58.274501 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-c24da0bd-987e-46b7-ac70-e3b57e436689 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:58.277318 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-c24da0bd-987e-46b7-ac70-e3b57e436689 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:58.282963 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c24da0bd-987e-46b7-ac70-e3b57e436689 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:58.283533 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c24da0bd-987e-46b7-ac70-e3b57e436689 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:58.284078 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c24da0bd-987e-46b7-ac70-e3b57e436689 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:58.284824 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c24da0bd-987e-46b7-ac70-e3b57e436689 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:58.285329 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c24da0bd-987e-46b7-ac70-e3b57e436689 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:58.285804 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c24da0bd-987e-46b7-ac70-e3b57e436689 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:58.316835 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-c24da0bd-987e-46b7-ac70-e3b57e436689 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046518 Aug 10 13:41:58.317425 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 265/557] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Aug 10 13:41:58 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 13:41:58.444007 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-c1db29f7-2bb5-4441-8406-d68b5f9c7f24 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:58.444703 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-c1db29f7-2bb5-4441-8406-d68b5f9c7f24 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:58.451000 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c1db29f7-2bb5-4441-8406-d68b5f9c7f24 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:58.451484 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c1db29f7-2bb5-4441-8406-d68b5f9c7f24 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:58.451929 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c1db29f7-2bb5-4441-8406-d68b5f9c7f24 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:58.452678 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c1db29f7-2bb5-4441-8406-d68b5f9c7f24 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:58.453129 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c1db29f7-2bb5-4441-8406-d68b5f9c7f24 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:58.453572 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c1db29f7-2bb5-4441-8406-d68b5f9c7f24 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:58.596006 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-c1db29f7-2bb5-4441-8406-d68b5f9c7f24 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:58.604895 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-c1db29f7-2bb5-4441-8406-d68b5f9c7f24 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1757 microversion: 2.1 time: 0.165220 Aug 10 13:41:58.605595 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 293/558] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:58 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:59.330267 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-43487adc-dd39-4cf8-ae86-9c205e1b2e00 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:59.332517 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-43487adc-dd39-4cf8-ae86-9c205e1b2e00 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:59.338886 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-43487adc-dd39-4cf8-ae86-9c205e1b2e00 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:59.339366 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-43487adc-dd39-4cf8-ae86-9c205e1b2e00 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:59.339801 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-43487adc-dd39-4cf8-ae86-9c205e1b2e00 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:59.340484 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-43487adc-dd39-4cf8-ae86-9c205e1b2e00 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:59.340939 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-43487adc-dd39-4cf8-ae86-9c205e1b2e00 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:59.341403 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-43487adc-dd39-4cf8-ae86-9c205e1b2e00 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:59.370897 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-43487adc-dd39-4cf8-ae86-9c205e1b2e00 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045389 Aug 10 13:41:59.371488 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 266/559] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Aug 10 13:41:59 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:41:59.436815 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-aaa7dbf2-4cd1-4638-92e4-d516db6b3e32 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:59.437394 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-aaa7dbf2-4cd1-4638-92e4-d516db6b3e32 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:59.444064 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-aaa7dbf2-4cd1-4638-92e4-d516db6b3e32 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:59.444576 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-aaa7dbf2-4cd1-4638-92e4-d516db6b3e32 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:59.445013 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-aaa7dbf2-4cd1-4638-92e4-d516db6b3e32 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:59.445730 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-aaa7dbf2-4cd1-4638-92e4-d516db6b3e32 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:59.446258 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-aaa7dbf2-4cd1-4638-92e4-d516db6b3e32 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:59.446639 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-aaa7dbf2-4cd1-4638-92e4-d516db6b3e32 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:59.471470 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-aaa7dbf2-4cd1-4638-92e4-d516db6b3e32 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Going to try to terminate instance {{(pid=129522) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:41:59.485842 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:41:59.553038 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-aaa7dbf2-4cd1-4638-92e4-d516db6b3e32 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 204 len: 0 microversion: 2.20 time: 0.119464 Aug 10 13:41:59.553948 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 294/560] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Aug 10 13:41:59 2022] DELETE /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 13:41:59.562990 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-225e7003-805e-49fc-acaa-f3bb0cdae1b9 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:59.564262 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-225e7003-805e-49fc-acaa-f3bb0cdae1b9 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:59.573136 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-225e7003-805e-49fc-acaa-f3bb0cdae1b9 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:59.573663 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-225e7003-805e-49fc-acaa-f3bb0cdae1b9 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:59.574101 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-225e7003-805e-49fc-acaa-f3bb0cdae1b9 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:59.574807 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-225e7003-805e-49fc-acaa-f3bb0cdae1b9 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:59.575331 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-225e7003-805e-49fc-acaa-f3bb0cdae1b9 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:59.575764 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-225e7003-805e-49fc-acaa-f3bb0cdae1b9 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:59.627576 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-a25a513d-2eb6-4538-9f6f-14bde12e2880 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:41:59.628273 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-a25a513d-2eb6-4538-9f6f-14bde12e2880 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:41:59.634224 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a25a513d-2eb6-4538-9f6f-14bde12e2880 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:59.634708 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a25a513d-2eb6-4538-9f6f-14bde12e2880 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:59.635142 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a25a513d-2eb6-4538-9f6f-14bde12e2880 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:59.635863 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a25a513d-2eb6-4538-9f6f-14bde12e2880 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:41:59.636321 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a25a513d-2eb6-4538-9f6f-14bde12e2880 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:41:59.636743 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a25a513d-2eb6-4538-9f6f-14bde12e2880 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:41:59.714509 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-225e7003-805e-49fc-acaa-f3bb0cdae1b9 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:59.723046 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-225e7003-805e-49fc-acaa-f3bb0cdae1b9 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:59.724453 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-225e7003-805e-49fc-acaa-f3bb0cdae1b9 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:59.726112 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-225e7003-805e-49fc-acaa-f3bb0cdae1b9 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1725 microversion: 2.20 time: 0.167355 Aug 10 13:41:59.726322 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 267/561] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:41:59 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:41:59.794977 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-a25a513d-2eb6-4538-9f6f-14bde12e2880 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:41:59.803770 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-a25a513d-2eb6-4538-9f6f-14bde12e2880 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1757 microversion: 2.1 time: 0.180778 Aug 10 13:41:59.804283 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 295/562] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:41:59 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:42:00.352564 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-e7a29c3a-c047-459d-81fe-0f933abb9bdc tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:00.353080 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-e7a29c3a-c047-459d-81fe-0f933abb9bdc tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 16659e37-a119-4243-8211-1179306997a5] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:00.359565 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e7a29c3a-c047-459d-81fe-0f933abb9bdc tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:00.360718 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e7a29c3a-c047-459d-81fe-0f933abb9bdc tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:00.361155 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e7a29c3a-c047-459d-81fe-0f933abb9bdc tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:00.361865 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e7a29c3a-c047-459d-81fe-0f933abb9bdc tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:00.362314 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e7a29c3a-c047-459d-81fe-0f933abb9bdc tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:00.362981 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e7a29c3a-c047-459d-81fe-0f933abb9bdc tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:00.388159 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-e7a29c3a-c047-459d-81fe-0f933abb9bdc tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 16659e37-a119-4243-8211-1179306997a5] Going to try to terminate instance {{(pid=129523) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:42:00.462220 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-e7a29c3a-c047-459d-81fe-0f933abb9bdc tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "DELETE /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5" status: 204 len: 0 microversion: 2.1 time: 0.113236 Aug 10 13:42:00.462926 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 268/563] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 10 13:42:00 2022] DELETE /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:42:00.471728 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-2ba1328f-b638-4b1b-a84d-4b0e83e293fe tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:00.472335 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-2ba1328f-b638-4b1b-a84d-4b0e83e293fe tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 16659e37-a119-4243-8211-1179306997a5] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:00.478389 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2ba1328f-b638-4b1b-a84d-4b0e83e293fe tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:00.478864 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2ba1328f-b638-4b1b-a84d-4b0e83e293fe tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:00.479291 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2ba1328f-b638-4b1b-a84d-4b0e83e293fe tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:00.479997 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2ba1328f-b638-4b1b-a84d-4b0e83e293fe tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:00.480468 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2ba1328f-b638-4b1b-a84d-4b0e83e293fe tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:00.480912 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2ba1328f-b638-4b1b-a84d-4b0e83e293fe tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:00.612095 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-2ba1328f-b638-4b1b-a84d-4b0e83e293fe tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:00.619818 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-2ba1328f-b638-4b1b-a84d-4b0e83e293fe tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5" status: 200 len: 1577 microversion: 2.1 time: 0.152552 Aug 10 13:42:00.620386 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 296/564] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:00 2022] GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:00.750016 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-b748df21-39ec-44fa-8bf7-e87e73a7a188 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:00.750716 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-b748df21-39ec-44fa-8bf7-e87e73a7a188 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:00.756506 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b748df21-39ec-44fa-8bf7-e87e73a7a188 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:00.756988 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b748df21-39ec-44fa-8bf7-e87e73a7a188 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:00.757460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b748df21-39ec-44fa-8bf7-e87e73a7a188 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:00.758220 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b748df21-39ec-44fa-8bf7-e87e73a7a188 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:00.758669 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b748df21-39ec-44fa-8bf7-e87e73a7a188 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:00.759090 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b748df21-39ec-44fa-8bf7-e87e73a7a188 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:00.826348 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-ff859d91-308b-4357-8875-1b267bdacce7 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:00.826876 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-ff859d91-308b-4357-8875-1b267bdacce7 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:00.833422 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ff859d91-308b-4357-8875-1b267bdacce7 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:00.833941 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ff859d91-308b-4357-8875-1b267bdacce7 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:00.834399 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ff859d91-308b-4357-8875-1b267bdacce7 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:00.835156 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ff859d91-308b-4357-8875-1b267bdacce7 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:00.835606 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ff859d91-308b-4357-8875-1b267bdacce7 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:00.836027 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ff859d91-308b-4357-8875-1b267bdacce7 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:00.895601 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-b748df21-39ec-44fa-8bf7-e87e73a7a188 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:00.903657 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-b748df21-39ec-44fa-8bf7-e87e73a7a188 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:00.905155 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-b748df21-39ec-44fa-8bf7-e87e73a7a188 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:00.906498 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-b748df21-39ec-44fa-8bf7-e87e73a7a188 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1725 microversion: 2.20 time: 0.160804 Aug 10 13:42:00.907661 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 269/565] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:42:00 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:42:00.980281 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-ff859d91-308b-4357-8875-1b267bdacce7 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:00.989144 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-ff859d91-308b-4357-8875-1b267bdacce7 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1757 microversion: 2.1 time: 0.166987 Aug 10 13:42:00.989734 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 297/566] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:00 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:42:01.642170 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-4025d867-aecc-40e6-a929-845496936265 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:01.642780 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-4025d867-aecc-40e6-a929-845496936265 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 16659e37-a119-4243-8211-1179306997a5] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:01.649183 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4025d867-aecc-40e6-a929-845496936265 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:01.649818 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4025d867-aecc-40e6-a929-845496936265 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:01.650394 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4025d867-aecc-40e6-a929-845496936265 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:01.651307 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4025d867-aecc-40e6-a929-845496936265 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:01.651769 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4025d867-aecc-40e6-a929-845496936265 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:01.652186 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4025d867-aecc-40e6-a929-845496936265 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:01.671113 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:42:01.782675 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-4025d867-aecc-40e6-a929-845496936265 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:01.790247 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-4025d867-aecc-40e6-a929-845496936265 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5" status: 200 len: 1577 microversion: 2.1 time: 0.152057 Aug 10 13:42:01.790808 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 270/567] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:01 2022] GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:01.929593 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-62238bfe-0103-4c48-adc6-22cfb89bc4a3 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:01.930141 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-62238bfe-0103-4c48-adc6-22cfb89bc4a3 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:01.936447 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-62238bfe-0103-4c48-adc6-22cfb89bc4a3 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:01.936926 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-62238bfe-0103-4c48-adc6-22cfb89bc4a3 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:01.937392 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-62238bfe-0103-4c48-adc6-22cfb89bc4a3 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:01.938084 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-62238bfe-0103-4c48-adc6-22cfb89bc4a3 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:01.939110 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-62238bfe-0103-4c48-adc6-22cfb89bc4a3 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:01.939535 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-62238bfe-0103-4c48-adc6-22cfb89bc4a3 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:02.009871 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-024762b3-bbf8-4a62-869c-7ef6e6cc84de tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:02.010491 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-024762b3-bbf8-4a62-869c-7ef6e6cc84de tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:02.017205 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-024762b3-bbf8-4a62-869c-7ef6e6cc84de tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:02.017730 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-024762b3-bbf8-4a62-869c-7ef6e6cc84de tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:02.018163 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-024762b3-bbf8-4a62-869c-7ef6e6cc84de tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:02.018866 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-024762b3-bbf8-4a62-869c-7ef6e6cc84de tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:02.019320 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-024762b3-bbf8-4a62-869c-7ef6e6cc84de tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:02.019741 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-024762b3-bbf8-4a62-869c-7ef6e6cc84de tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:02.086011 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-62238bfe-0103-4c48-adc6-22cfb89bc4a3 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:02.093831 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-62238bfe-0103-4c48-adc6-22cfb89bc4a3 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:02.095884 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-62238bfe-0103-4c48-adc6-22cfb89bc4a3 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:02.097052 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-62238bfe-0103-4c48-adc6-22cfb89bc4a3 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1725 microversion: 2.20 time: 0.171377 Aug 10 13:42:02.097648 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 298/568] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:42:01 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:42:02.165738 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-024762b3-bbf8-4a62-869c-7ef6e6cc84de tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:02.173677 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-024762b3-bbf8-4a62-869c-7ef6e6cc84de tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1757 microversion: 2.1 time: 0.167581 Aug 10 13:42:02.174239 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 271/569] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:02 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:42:02.811760 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-03ce0f08-5ce2-4af2-a9c4-d13daf32016a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:02.812368 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-03ce0f08-5ce2-4af2-a9c4-d13daf32016a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 16659e37-a119-4243-8211-1179306997a5] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:02.818437 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-03ce0f08-5ce2-4af2-a9c4-d13daf32016a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:02.818920 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-03ce0f08-5ce2-4af2-a9c4-d13daf32016a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:02.819353 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-03ce0f08-5ce2-4af2-a9c4-d13daf32016a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:02.820051 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-03ce0f08-5ce2-4af2-a9c4-d13daf32016a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:02.820504 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-03ce0f08-5ce2-4af2-a9c4-d13daf32016a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:02.820925 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-03ce0f08-5ce2-4af2-a9c4-d13daf32016a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:02.960497 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-03ce0f08-5ce2-4af2-a9c4-d13daf32016a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:02.967915 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-03ce0f08-5ce2-4af2-a9c4-d13daf32016a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5" status: 200 len: 1577 microversion: 2.1 time: 0.160088 Aug 10 13:42:02.968476 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 299/570] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:02 2022] GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:03.119991 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-479bfc8a-4b33-48ec-9626-bd83dcd35459 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:03.120537 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-479bfc8a-4b33-48ec-9626-bd83dcd35459 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:03.129280 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-479bfc8a-4b33-48ec-9626-bd83dcd35459 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:03.130163 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-479bfc8a-4b33-48ec-9626-bd83dcd35459 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:03.130784 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-479bfc8a-4b33-48ec-9626-bd83dcd35459 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:03.131727 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-479bfc8a-4b33-48ec-9626-bd83dcd35459 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:03.132234 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-479bfc8a-4b33-48ec-9626-bd83dcd35459 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:03.132704 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-479bfc8a-4b33-48ec-9626-bd83dcd35459 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:03.194718 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-5941622e-aa12-4706-8e92-c6e5f8d3fc11 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:03.195324 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-5941622e-aa12-4706-8e92-c6e5f8d3fc11 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:03.201222 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5941622e-aa12-4706-8e92-c6e5f8d3fc11 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:03.201740 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5941622e-aa12-4706-8e92-c6e5f8d3fc11 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:03.202171 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5941622e-aa12-4706-8e92-c6e5f8d3fc11 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:03.202870 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5941622e-aa12-4706-8e92-c6e5f8d3fc11 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:03.203319 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5941622e-aa12-4706-8e92-c6e5f8d3fc11 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:03.203783 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5941622e-aa12-4706-8e92-c6e5f8d3fc11 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:03.276604 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-479bfc8a-4b33-48ec-9626-bd83dcd35459 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:03.285500 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-479bfc8a-4b33-48ec-9626-bd83dcd35459 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:03.287167 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-479bfc8a-4b33-48ec-9626-bd83dcd35459 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:03.288473 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-479bfc8a-4b33-48ec-9626-bd83dcd35459 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1725 microversion: 2.20 time: 0.172673 Aug 10 13:42:03.289135 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 272/571] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:42:03 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:42:03.473210 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-5941622e-aa12-4706-8e92-c6e5f8d3fc11 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:03.487399 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-5941622e-aa12-4706-8e92-c6e5f8d3fc11 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1760 microversion: 2.1 time: 0.296374 Aug 10 13:42:03.488605 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 300/572] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:03 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1760 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:42:03.994688 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-a1baa087-47dd-4709-9f1a-5f8564c3a062 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:03.995723 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-a1baa087-47dd-4709-9f1a-5f8564c3a062 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 16659e37-a119-4243-8211-1179306997a5] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:04.006232 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a1baa087-47dd-4709-9f1a-5f8564c3a062 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:04.007043 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a1baa087-47dd-4709-9f1a-5f8564c3a062 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:04.008055 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a1baa087-47dd-4709-9f1a-5f8564c3a062 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:04.009507 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a1baa087-47dd-4709-9f1a-5f8564c3a062 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:04.010279 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a1baa087-47dd-4709-9f1a-5f8564c3a062 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:04.011149 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a1baa087-47dd-4709-9f1a-5f8564c3a062 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:04.309495 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-74d6f23a-99b6-4d9b-ab5e-cc2025f453b7 req-efa6605d-b1e8-4ebe-b4d0-d0739d9bc99f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdba9a34-3f3e-4314-a377-e6dc259c27cb", "name": "network-vif-deleted", "tag": "3fd93ef8-553f-4b67-8470-c80fc47f7c94"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:42:04.327900 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-74d6f23a-99b6-4d9b-ab5e-cc2025f453b7 req-efa6605d-b1e8-4ebe-b4d0-d0739d9bc99f service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:04.329652 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-74d6f23a-99b6-4d9b-ab5e-cc2025f453b7 req-efa6605d-b1e8-4ebe-b4d0-d0739d9bc99f service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:04.336434 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-74d6f23a-99b6-4d9b-ab5e-cc2025f453b7 req-efa6605d-b1e8-4ebe-b4d0-d0739d9bc99f service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:04.351247 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-74d6f23a-99b6-4d9b-ab5e-cc2025f453b7 req-efa6605d-b1e8-4ebe-b4d0-d0739d9bc99f service nova] Creating event network-vif-deleted:3fd93ef8-553f-4b67-8470-c80fc47f7c94 for instance cdba9a34-3f3e-4314-a377-e6dc259c27cb on hv-cinder-85200 Aug 10 13:42:04.358869 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-74d6f23a-99b6-4d9b-ab5e-cc2025f453b7 req-efa6605d-b1e8-4ebe-b4d0-d0739d9bc99f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059680 Aug 10 13:42:04.361200 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 301/573] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:42:04.371979 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-5d374919-8db2-456e-9b63-624d8d2fb05f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:04.374949 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-5d374919-8db2-456e-9b63-624d8d2fb05f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:04.415791 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5d374919-8db2-456e-9b63-624d8d2fb05f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:04.425880 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5d374919-8db2-456e-9b63-624d8d2fb05f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:04.426778 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5d374919-8db2-456e-9b63-624d8d2fb05f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:04.428510 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5d374919-8db2-456e-9b63-624d8d2fb05f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:04.429472 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5d374919-8db2-456e-9b63-624d8d2fb05f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:04.431841 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5d374919-8db2-456e-9b63-624d8d2fb05f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:04.538607 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-5d374919-8db2-456e-9b63-624d8d2fb05f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:04.548227 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-5d374919-8db2-456e-9b63-624d8d2fb05f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:04.550447 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-5d374919-8db2-456e-9b63-624d8d2fb05f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:04.552189 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-5d374919-8db2-456e-9b63-624d8d2fb05f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 200 len: 1367 microversion: 2.20 time: 0.189348 Aug 10 13:42:04.553273 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 302/574] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:42:04 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:42:04.638998 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-a1baa087-47dd-4709-9f1a-5f8564c3a062 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:04.647835 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-a1baa087-47dd-4709-9f1a-5f8564c3a062 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5" status: 200 len: 1577 microversion: 2.1 time: 0.659807 Aug 10 13:42:04.651737 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 273/575] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:03 2022] GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5 => generated 1577 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:04.923289 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-7e7d75cf-813a-4de5-a71a-5b5b36dd0860 req-839f49aa-2b78-4d99-8341-af8ffefb629b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16659e37-a119-4243-8211-1179306997a5", "name": "network-vif-deleted", "tag": "315a8c1b-37a4-4871-af0b-4f209b89cc17"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:42:04.940851 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-7e7d75cf-813a-4de5-a71a-5b5b36dd0860 req-839f49aa-2b78-4d99-8341-af8ffefb629b service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:04.941413 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-7e7d75cf-813a-4de5-a71a-5b5b36dd0860 req-839f49aa-2b78-4d99-8341-af8ffefb629b service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:04.941923 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-7e7d75cf-813a-4de5-a71a-5b5b36dd0860 req-839f49aa-2b78-4d99-8341-af8ffefb629b service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:04.975646 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-7e7d75cf-813a-4de5-a71a-5b5b36dd0860 req-839f49aa-2b78-4d99-8341-af8ffefb629b service nova] Creating event network-vif-deleted:315a8c1b-37a4-4871-af0b-4f209b89cc17 for instance 16659e37-a119-4243-8211-1179306997a5 on hv-cinder-85200 Aug 10 13:42:04.986923 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-7e7d75cf-813a-4de5-a71a-5b5b36dd0860 req-839f49aa-2b78-4d99-8341-af8ffefb629b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073223 Aug 10 13:42:04.987965 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 303/576] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:42:05.577771 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-3549980e-3cc8-40f9-8524-6149a02645e6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:05.578432 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-3549980e-3cc8-40f9-8524-6149a02645e6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:05.585986 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3549980e-3cc8-40f9-8524-6149a02645e6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:05.586720 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3549980e-3cc8-40f9-8524-6149a02645e6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:05.587207 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3549980e-3cc8-40f9-8524-6149a02645e6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:05.587949 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3549980e-3cc8-40f9-8524-6149a02645e6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:05.588434 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3549980e-3cc8-40f9-8524-6149a02645e6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:05.588862 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3549980e-3cc8-40f9-8524-6149a02645e6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:05.603404 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.wsgi [None req-3549980e-3cc8-40f9-8524-6149a02645e6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] HTTP exception thrown: Instance cdba9a34-3f3e-4314-a377-e6dc259c27cb could not be found. Aug 10 13:42:05.605059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-3549980e-3cc8-40f9-8524-6149a02645e6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Request method failure captured: Aug 10 13:42:05.605059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: request: GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb HTTP/1.1 Aug 10 13:42:05.605059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept: application/json Aug 10 13:42:05.605059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept-Encoding: identity Aug 10 13:42:05.605059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Connection: close Aug 10 13:42:05.605059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Length: 0 Aug 10 13:42:05.605059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Type: application/json Aug 10 13:42:05.605059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Host: 10.222.0.52 Aug 10 13:42:05.605059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Openstack-System-Scope: None Aug 10 13:42:05.605059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: User-Agent: python-urllib3/1.26.11 Aug 10 13:42:05.605059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Auth-Token: gAAAAABi87SjyxddKhUB7OUwPME21JMZGNdpbtCe9Qe7UZOBNnEqoMdGpeDVGCtahrN9iVRiXf3MBCGKxvt5ZDHVakZChOWNOR7x8LO7HCcoNIIwyXtoZlQ5CvJl1zAp5Hh5JeQRi8YGR91f8U8cbGHkEUbpcOG2SjLXruf_gDYc1HnXb6IZMDs Aug 10 13:42:05.605059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Id: None Aug 10 13:42:05.605059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Name: None Aug 10 13:42:05.605059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Identity-Status: Confirmed Aug 10 13:42:05.605059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Is-Admin-Project: True Aug 10 13:42:05.605059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 13:42:05.605059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Id: default Aug 10 13:42:05.605059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Name: Default Aug 10 13:42:05.605059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Id: b6cfb6539b69493ebef06cf7176b1935 Aug 10 13:42:05.605059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-854584124 Aug 10 13:42:05.605059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Role: member,reader Aug 10 13:42:05.605059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Roles: member,reader Aug 10 13:42:05.606901 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b6cfb6539b69493ebef06cf7176b1935"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b6cfb6539b69493ebef06cf7176b1935"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b6cfb6539b69493ebef06cf7176b1935", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b6cfb6539b69493ebef06cf7176b1935"}]}] Aug 10 13:42:05.606901 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant: tempest-AttachVolumeShelveTestJSON-854584124 Aug 10 13:42:05.606901 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Id: b6cfb6539b69493ebef06cf7176b1935 Aug 10 13:42:05.606901 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-854584124 Aug 10 13:42:05.606901 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User: tempest-AttachVolumeShelveTestJSON-854584124-project Aug 10 13:42:05.606901 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Id: default Aug 10 13:42:05.606901 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Name: Default Aug 10 13:42:05.606901 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Id: 9cecae4323404bd29fe8c05a704de273 Aug 10 13:42:05.606901 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Name: tempest-AttachVolumeShelveTestJSON-854584124-project Aug 10 13:42:05.606901 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: method: > Aug 10 13:42:05.606901 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: exception: Instance cdba9a34-3f3e-4314-a377-e6dc259c27cb could not be found. Aug 10 13:42:05.606901 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: action_args: {'id': 'cdba9a34-3f3e-4314-a377-e6dc259c27cb'} Aug 10 13:42:05.607944 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:42:05.607944 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:42:05.607944 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:42:05.607944 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:42:05.607944 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:42:05.607944 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:42:05.607944 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:42:05.607944 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:42:05.607944 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:42:05.607944 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:42:05.607944 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdba9a34-3f3e-4314-a377-e6dc259c27cb could not be found. Aug 10 13:42:05.607944 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:42:05.607944 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:42:05.607944 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:42:05.607944 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:42:05.607944 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:42:05.607944 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:42:05.607944 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:42:05.607944 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:42:05.607944 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:42:05.609462 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:42:05.609462 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:42:05.609462 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:42:05.609462 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:42:05.609462 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:42:05.609462 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:42:05.609462 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:42:05.609462 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdba9a34-3f3e-4314-a377-e6dc259c27cb could not be found. Aug 10 13:42:05.609462 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:42:05.609462 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:42:05.609462 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:42:05.609462 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:42:05.609462 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:42:05.609462 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:42:05.609462 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:42:05.609462 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:42:05.609462 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdba9a34-3f3e-4314-a377-e6dc259c27cb could not be found. Aug 10 13:42:05.609462 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:42:05.611494 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-3549980e-3cc8-40f9-8524-6149a02645e6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Returning 404 to user: Instance cdba9a34-3f3e-4314-a377-e6dc259c27cb could not be found. {{(pid=129523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:42:05.611494 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-3549980e-3cc8-40f9-8524-6149a02645e6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 404 len: 111 microversion: 2.20 time: 0.032899 Aug 10 13:42:05.611494 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 274/577] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:42:05 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 13:42:05.616335 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-0a1d70c4-d8f8-4b9a-924c-5618947ea8d7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '.version_select at 0x7f49c45dc820>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:05.626106 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:42:05.649507 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-0a1d70c4-d8f8-4b9a-924c-5618947ea8d7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1251158532" status: 204 len: 0 microversion: 2.20 time: 0.037440 Aug 10 13:42:05.655168 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 304/578] 10.222.0.52 () {60 vars in 1262 bytes} [Wed Aug 10 13:42:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1251158532 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 13:42:05.669817 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-499b4b96-36be-409a-b3d3-984e46aad84e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:05.670578 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-499b4b96-36be-409a-b3d3-984e46aad84e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 16659e37-a119-4243-8211-1179306997a5] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:05.678333 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-499b4b96-36be-409a-b3d3-984e46aad84e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:05.678821 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-499b4b96-36be-409a-b3d3-984e46aad84e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:05.679423 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-499b4b96-36be-409a-b3d3-984e46aad84e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:05.680534 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-499b4b96-36be-409a-b3d3-984e46aad84e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:05.681185 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-499b4b96-36be-409a-b3d3-984e46aad84e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:05.681631 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-499b4b96-36be-409a-b3d3-984e46aad84e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:05.728548 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-499b4b96-36be-409a-b3d3-984e46aad84e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:05.729142 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-499b4b96-36be-409a-b3d3-984e46aad84e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:05.729677 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-499b4b96-36be-409a-b3d3-984e46aad84e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:05.730930 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.objects.instance [None req-499b4b96-36be-409a-b3d3-984e46aad84e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lazy-loading 'fault' on Instance uuid 16659e37-a119-4243-8211-1179306997a5 {{(pid=129523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:42:05.784642 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-499b4b96-36be-409a-b3d3-984e46aad84e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:05.798542 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-499b4b96-36be-409a-b3d3-984e46aad84e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5" status: 200 len: 1184 microversion: 2.1 time: 0.132748 Aug 10 13:42:05.799218 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 275/579] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:05 2022] GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5 => generated 1184 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:06.386466 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-1f131827-c18a-45f6-9cab-498415e4fdef tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Action: 'create', calling method: .version_select at 0x7f49c46a2280>, body: {"keypair": {"name": "tempest-keypair-1410104779", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlGbbUDNfKZF9cOzYF5XYuF+piPpu2mZNBrrML2Nav0CwdDkc33c+Ut5/vk1R80PzRGUvLdKzPgFjE4QruCMja6PETPrSBhchE1UiHA3u4BrRxsPl93+nRzm0CHx7RU+w=="}} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:42:06.403017 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.quota [None req-1f131827-c18a-45f6-9cab-498415e4fdef tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Getting quotas for project b6cfb6539b69493ebef06cf7176b1935. Resources: {'key_pairs'} {{(pid=129522) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:42:06.407551 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.quota [None req-1f131827-c18a-45f6-9cab-498415e4fdef tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Getting quotas for user 9cecae4323404bd29fe8c05a704de273 and project b6cfb6539b69493ebef06cf7176b1935. Resources: {'key_pairs'} {{(pid=129522) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:42:06.428410 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-1f131827-c18a-45f6-9cab-498415e4fdef tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.046034 Aug 10 13:42:06.429003 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 305/580] 10.222.0.52 () {62 vars in 1200 bytes} [Wed Aug 10 13:42:06 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 10 13:42:06.823662 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-21e9e080-9dde-4066-baf3-e5afcf43ebf2 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:06.824358 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-21e9e080-9dde-4066-baf3-e5afcf43ebf2 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 16659e37-a119-4243-8211-1179306997a5] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:06.833040 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-21e9e080-9dde-4066-baf3-e5afcf43ebf2 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:06.833351 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-21e9e080-9dde-4066-baf3-e5afcf43ebf2 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:06.833839 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-21e9e080-9dde-4066-baf3-e5afcf43ebf2 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:06.834572 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-21e9e080-9dde-4066-baf3-e5afcf43ebf2 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:06.835035 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-21e9e080-9dde-4066-baf3-e5afcf43ebf2 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:06.835455 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-21e9e080-9dde-4066-baf3-e5afcf43ebf2 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:06.849907 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.wsgi [None req-21e9e080-9dde-4066-baf3-e5afcf43ebf2 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] HTTP exception thrown: Instance 16659e37-a119-4243-8211-1179306997a5 could not be found. Aug 10 13:42:06.851460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-21e9e080-9dde-4066-baf3-e5afcf43ebf2 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Request method failure captured: Aug 10 13:42:06.851460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: request: GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5 HTTP/1.1 Aug 10 13:42:06.851460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept: application/json Aug 10 13:42:06.851460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept-Encoding: identity Aug 10 13:42:06.851460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Connection: close Aug 10 13:42:06.851460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Length: 0 Aug 10 13:42:06.851460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Type: application/json Aug 10 13:42:06.851460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Host: 10.222.0.52 Aug 10 13:42:06.851460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Openstack-System-Scope: None Aug 10 13:42:06.851460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: User-Agent: python-urllib3/1.26.11 Aug 10 13:42:06.851460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Auth-Token: gAAAAABi87TSzxP2-YwwzoVQUCaIGZpUao_F-X-e3X9CWe3aw04cqEa58UtxCos4r-Q3NFdtiQhGTNowwWExRyEAyMlYgP4tsLTK5yzvxfKVpqHSHKFu7wTq3iH51AqunAJMGmD2Ry377K0xwLIwG9QqTwzXWE-7Zp72mPPCiwxzQiXyh6jtvqI Aug 10 13:42:06.851460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Id: None Aug 10 13:42:06.851460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Name: None Aug 10 13:42:06.851460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Identity-Status: Confirmed Aug 10 13:42:06.851460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Is-Admin-Project: True Aug 10 13:42:06.851460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Id: default Aug 10 13:42:06.851460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Name: Default Aug 10 13:42:06.851460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Id: b52f008781f64d09b706d478c8fe8922 Aug 10 13:42:06.851460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Name: tempest-TestVolumeBootPattern-1665317784 Aug 10 13:42:06.851460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Role: member,reader Aug 10 13:42:06.851460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Roles: member,reader Aug 10 13:42:06.853713 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b52f008781f64d09b706d478c8fe8922"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b52f008781f64d09b706d478c8fe8922"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b52f008781f64d09b706d478c8fe8922", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b52f008781f64d09b706d478c8fe8922"}]}] Aug 10 13:42:06.853713 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant: tempest-TestVolumeBootPattern-1665317784 Aug 10 13:42:06.853713 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Id: b52f008781f64d09b706d478c8fe8922 Aug 10 13:42:06.853713 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Name: tempest-TestVolumeBootPattern-1665317784 Aug 10 13:42:06.853713 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User: tempest-TestVolumeBootPattern-1665317784-project Aug 10 13:42:06.853713 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Id: default Aug 10 13:42:06.853713 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Name: Default Aug 10 13:42:06.853713 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Id: 411ff3f0306848ee91108343982806ca Aug 10 13:42:06.853713 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Name: tempest-TestVolumeBootPattern-1665317784-project Aug 10 13:42:06.853713 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: method: > Aug 10 13:42:06.853713 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: exception: Instance 16659e37-a119-4243-8211-1179306997a5 could not be found. Aug 10 13:42:06.853713 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: action_args: {'id': '16659e37-a119-4243-8211-1179306997a5'} Aug 10 13:42:06.854557 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:42:06.854557 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:42:06.854557 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:42:06.854557 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:42:06.854557 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:42:06.854557 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:42:06.854557 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:42:06.854557 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:42:06.854557 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:42:06.854557 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:42:06.854557 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16659e37-a119-4243-8211-1179306997a5 could not be found. Aug 10 13:42:06.854557 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:42:06.854557 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:42:06.854557 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:42:06.854557 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:42:06.854557 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:42:06.854557 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:42:06.854557 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:42:06.854557 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:42:06.854557 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:42:06.857493 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:42:06.857493 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:42:06.857493 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:42:06.857493 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:42:06.857493 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:42:06.857493 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:42:06.857493 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:42:06.857493 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16659e37-a119-4243-8211-1179306997a5 could not be found. Aug 10 13:42:06.857493 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:42:06.857493 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:42:06.857493 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:42:06.857493 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:42:06.857493 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:42:06.857493 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:42:06.857493 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:42:06.857493 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:42:06.857493 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16659e37-a119-4243-8211-1179306997a5 could not be found. Aug 10 13:42:06.857493 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:42:06.859174 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-21e9e080-9dde-4066-baf3-e5afcf43ebf2 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Returning 404 to user: Instance 16659e37-a119-4243-8211-1179306997a5 could not be found. {{(pid=129523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:42:06.859174 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-21e9e080-9dde-4066-baf3-e5afcf43ebf2 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5" status: 404 len: 111 microversion: 2.1 time: 0.035973 Aug 10 13:42:06.863956 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 276/581] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:06 2022] GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:42:06.976789 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-ee755047-61c2-4c6c-ad39-9c701e2af0d0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-584502997", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1990044180", "security_groups": [{"name": "tempest-secgroup-smoke-875459940"}], "block_device_mapping_v2": [{"uuid": "6ea3746d-3af7-4634-b2ee-d1107c0fca2a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0ffcae0f-06e6-4633-8b48-e556a2688783"}]}} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:42:07.099577 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.network.neutron [None req-ee755047-61c2-4c6c-ad39-9c701e2af0d0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] validate_networks() for [('0ffcae0f-06e6-4633-8b48-e556a2688783', None, None, None, None, None)] {{(pid=129522) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:42:07.714870 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.virt.hardware [None req-ee755047-61c2-4c6c-ad39-9c701e2af0d0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Flavor limits 0:0:0 {{(pid=129522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:42:07.715321 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.virt.hardware [None req-ee755047-61c2-4c6c-ad39-9c701e2af0d0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Image limits 0:0:0 {{(pid=129522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:42:07.715797 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.virt.hardware [None req-ee755047-61c2-4c6c-ad39-9c701e2af0d0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Flavor pref 0:0:0 {{(pid=129522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:42:07.716343 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.virt.hardware [None req-ee755047-61c2-4c6c-ad39-9c701e2af0d0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Image pref 0:0:0 {{(pid=129522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:42:07.717414 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.virt.hardware [None req-ee755047-61c2-4c6c-ad39-9c701e2af0d0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:42:07.729638 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ee755047-61c2-4c6c-ad39-9c701e2af0d0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:07.730129 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ee755047-61c2-4c6c-ad39-9c701e2af0d0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:07.730729 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ee755047-61c2-4c6c-ad39-9c701e2af0d0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:07.731522 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ee755047-61c2-4c6c-ad39-9c701e2af0d0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:07.731973 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ee755047-61c2-4c6c-ad39-9c701e2af0d0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:07.732391 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ee755047-61c2-4c6c-ad39-9c701e2af0d0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:07.750934 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.quota [None req-ee755047-61c2-4c6c-ad39-9c701e2af0d0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Getting quotas for project b52f008781f64d09b706d478c8fe8922. Resources: {'cores', 'ram', 'instances'} {{(pid=129522) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:42:07.755236 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.quota [None req-ee755047-61c2-4c6c-ad39-9c701e2af0d0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Getting quotas for user 411ff3f0306848ee91108343982806ca and project b52f008781f64d09b706d478c8fe8922. Resources: {'cores', 'ram', 'instances'} {{(pid=129522) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:42:07.816205 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-ee755047-61c2-4c6c-ad39-9c701e2af0d0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Going to run 1 instances... {{(pid=129522) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:42:07.818471 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-ee755047-61c2-4c6c-ad39-9c701e2af0d0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 160c89f2-984e-472a-8963-eeefb63824b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6ea3746d-3af7-4634-b2ee-d1107c0fca2a',volume_size=None,volume_type=None)] {{(pid=129522) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:42:07.835302 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-f62b7da5-29ef-44ba-ac69-9e57617bd6bc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-286719196", "imageRef": "096d81df-12b1-4175-b914-babe0fa931c6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b0f41cec-19b4-4ff0-8893-5680cf3ee461"}], "security_groups": [{"name": "tempest-securitygroup--1083202180"}], "key_name": "tempest-keypair-1410104779", "user_data": "}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:42:07.945096 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.network.neutron [None req-f62b7da5-29ef-44ba-ac69-9e57617bd6bc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] validate_networks() for [('b0f41cec-19b4-4ff0-8893-5680cf3ee461', None, None, None, None, None)] {{(pid=129523) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:42:07.956223 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-ee755047-61c2-4c6c-ad39-9c701e2af0d0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.983904 Aug 10 13:42:07.957054 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 306/582] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 10 13:42:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 13:42:07.968142 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-8beb1dce-a16e-4f05-84f9-41b08dbd4e29 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:07.968764 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-8beb1dce-a16e-4f05-84f9-41b08dbd4e29 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 160c89f2-984e-472a-8963-eeefb63824b1] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:08.024238 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-8beb1dce-a16e-4f05-84f9-41b08dbd4e29 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:08.031625 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-8beb1dce-a16e-4f05-84f9-41b08dbd4e29 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1" status: 200 len: 1094 microversion: 2.1 time: 0.067699 Aug 10 13:42:08.033263 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 307/583] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:07 2022] GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:42:08.340391 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-f62b7da5-29ef-44ba-ac69-9e57617bd6bc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Flavor limits 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:42:08.340821 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-f62b7da5-29ef-44ba-ac69-9e57617bd6bc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Image limits 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:42:08.341348 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-f62b7da5-29ef-44ba-ac69-9e57617bd6bc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Flavor pref 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:42:08.341726 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-f62b7da5-29ef-44ba-ac69-9e57617bd6bc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Image pref 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:42:08.342321 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-f62b7da5-29ef-44ba-ac69-9e57617bd6bc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:42:08.352047 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f62b7da5-29ef-44ba-ac69-9e57617bd6bc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:08.352528 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f62b7da5-29ef-44ba-ac69-9e57617bd6bc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:08.352962 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f62b7da5-29ef-44ba-ac69-9e57617bd6bc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:08.353744 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f62b7da5-29ef-44ba-ac69-9e57617bd6bc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:08.354198 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f62b7da5-29ef-44ba-ac69-9e57617bd6bc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:08.354620 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f62b7da5-29ef-44ba-ac69-9e57617bd6bc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:08.372193 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-f62b7da5-29ef-44ba-ac69-9e57617bd6bc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Getting quotas for project b6cfb6539b69493ebef06cf7176b1935. Resources: {'cores', 'ram', 'instances'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:42:08.376226 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-f62b7da5-29ef-44ba-ac69-9e57617bd6bc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Getting quotas for user 9cecae4323404bd29fe8c05a704de273 and project b6cfb6539b69493ebef06cf7176b1935. Resources: {'cores', 'ram', 'instances'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:42:08.387579 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-f62b7da5-29ef-44ba-ac69-9e57617bd6bc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Going to run 1 instances... {{(pid=129523) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:42:08.389803 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-f62b7da5-29ef-44ba-ac69-9e57617bd6bc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='096d81df-12b1-4175-b914-babe0fa931c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:42:08.435647 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-f62b7da5-29ef-44ba-ac69-9e57617bd6bc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.604415 Aug 10 13:42:08.436480 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 277/584] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Aug 10 13:42:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 10 13:42:08.448393 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-f04b12db-0a21-4f02-b367-343dc21daaab tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:08.449261 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-f04b12db-0a21-4f02-b367-343dc21daaab tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:08.508080 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-f04b12db-0a21-4f02-b367-343dc21daaab tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:08.515316 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-f04b12db-0a21-4f02-b367-343dc21daaab tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:08.518187 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-f04b12db-0a21-4f02-b367-343dc21daaab tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:08.518576 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-f04b12db-0a21-4f02-b367-343dc21daaab tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1281 microversion: 2.20 time: 0.075144 Aug 10 13:42:08.519132 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 308/585] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:42:08 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:42:09.053485 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-083bcf31-c1e9-435e-958b-3a623b0f88e6 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:09.054062 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-083bcf31-c1e9-435e-958b-3a623b0f88e6 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 160c89f2-984e-472a-8963-eeefb63824b1] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:09.061431 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-083bcf31-c1e9-435e-958b-3a623b0f88e6 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:09.061933 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-083bcf31-c1e9-435e-958b-3a623b0f88e6 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:09.062398 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-083bcf31-c1e9-435e-958b-3a623b0f88e6 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:09.063593 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-083bcf31-c1e9-435e-958b-3a623b0f88e6 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:09.064036 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-083bcf31-c1e9-435e-958b-3a623b0f88e6 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:09.064477 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-083bcf31-c1e9-435e-958b-3a623b0f88e6 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:09.132894 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-083bcf31-c1e9-435e-958b-3a623b0f88e6 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:09.141168 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-083bcf31-c1e9-435e-958b-3a623b0f88e6 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1" status: 200 len: 1192 microversion: 2.1 time: 0.091532 Aug 10 13:42:09.142014 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 278/586] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:09 2022] GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1 => generated 1192 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:09.542174 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-576544b2-96e3-4157-9e28-425fcf4000f1 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:09.542992 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-576544b2-96e3-4157-9e28-425fcf4000f1 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:09.549265 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-576544b2-96e3-4157-9e28-425fcf4000f1 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:09.549762 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-576544b2-96e3-4157-9e28-425fcf4000f1 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:09.550205 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-576544b2-96e3-4157-9e28-425fcf4000f1 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:09.550916 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-576544b2-96e3-4157-9e28-425fcf4000f1 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:09.551388 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-576544b2-96e3-4157-9e28-425fcf4000f1 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:09.551774 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-576544b2-96e3-4157-9e28-425fcf4000f1 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:09.615842 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-576544b2-96e3-4157-9e28-425fcf4000f1 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:09.625183 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-576544b2-96e3-4157-9e28-425fcf4000f1 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:09.626756 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-576544b2-96e3-4157-9e28-425fcf4000f1 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:09.627934 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-576544b2-96e3-4157-9e28-425fcf4000f1 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1333 microversion: 2.20 time: 0.091099 Aug 10 13:42:09.628606 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 309/587] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:42:09 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1333 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:42:10.174763 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-5be872cf-0f72-422b-bc7b-15a874df1e9f tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:10.175401 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-5be872cf-0f72-422b-bc7b-15a874df1e9f tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 160c89f2-984e-472a-8963-eeefb63824b1] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:10.190859 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5be872cf-0f72-422b-bc7b-15a874df1e9f tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:10.191824 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5be872cf-0f72-422b-bc7b-15a874df1e9f tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:10.192437 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5be872cf-0f72-422b-bc7b-15a874df1e9f tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:10.193370 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5be872cf-0f72-422b-bc7b-15a874df1e9f tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:10.193991 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5be872cf-0f72-422b-bc7b-15a874df1e9f tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:10.194806 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5be872cf-0f72-422b-bc7b-15a874df1e9f tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:10.410878 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-5be872cf-0f72-422b-bc7b-15a874df1e9f tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:10.420789 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-5be872cf-0f72-422b-bc7b-15a874df1e9f tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1" status: 200 len: 1265 microversion: 2.1 time: 0.261614 Aug 10 13:42:10.421413 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 279/588] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:10 2022] GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1 => generated 1265 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:10.652451 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-e0f3d003-ee18-40d3-8a3a-f42c6910fe11 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:10.652898 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-e0f3d003-ee18-40d3-8a3a-f42c6910fe11 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:10.659945 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e0f3d003-ee18-40d3-8a3a-f42c6910fe11 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:10.660435 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e0f3d003-ee18-40d3-8a3a-f42c6910fe11 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:10.660869 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e0f3d003-ee18-40d3-8a3a-f42c6910fe11 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:10.665135 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e0f3d003-ee18-40d3-8a3a-f42c6910fe11 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:10.665665 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e0f3d003-ee18-40d3-8a3a-f42c6910fe11 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:10.666103 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e0f3d003-ee18-40d3-8a3a-f42c6910fe11 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:10.954652 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-e0f3d003-ee18-40d3-8a3a-f42c6910fe11 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:10.967050 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-e0f3d003-ee18-40d3-8a3a-f42c6910fe11 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:10.970549 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-e0f3d003-ee18-40d3-8a3a-f42c6910fe11 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:10.973961 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-e0f3d003-ee18-40d3-8a3a-f42c6910fe11 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1407 microversion: 2.20 time: 0.324261 Aug 10 13:42:10.990600 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 310/589] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:42:10 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1407 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:42:11.014503 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-7c2cce74-3d06-4b75-82de-229dbcee3109 req-b5a427f4-f8cc-4c17-b383-2989082cda5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "160c89f2-984e-472a-8963-eeefb63824b1", "tag": "6cf489ec-5def-460d-a9f9-421d77157738"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:42:11.035084 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-7c2cce74-3d06-4b75-82de-229dbcee3109 req-b5a427f4-f8cc-4c17-b383-2989082cda5d service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:11.035878 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-7c2cce74-3d06-4b75-82de-229dbcee3109 req-b5a427f4-f8cc-4c17-b383-2989082cda5d service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:11.037076 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-7c2cce74-3d06-4b75-82de-229dbcee3109 req-b5a427f4-f8cc-4c17-b383-2989082cda5d service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:11.049388 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-7c2cce74-3d06-4b75-82de-229dbcee3109 req-b5a427f4-f8cc-4c17-b383-2989082cda5d service nova] Creating event network-changed:6cf489ec-5def-460d-a9f9-421d77157738 for instance 160c89f2-984e-472a-8963-eeefb63824b1 on hv-cinder-85200 Aug 10 13:42:11.059187 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-7c2cce74-3d06-4b75-82de-229dbcee3109 req-b5a427f4-f8cc-4c17-b383-2989082cda5d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048421 Aug 10 13:42:11.060074 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 280/590] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:42:11.320096 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-37bba5ca-f7bc-478a-bd26-1a826846bf9d req-5aa45c96-c33b-426b-b672-887d6478fda6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aa512f7-4b23-46bf-aa72-a3f72f2e122f", "tag": "1c042378-ea6a-4e4d-a088-c806fdfbe4e9"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:42:11.336684 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-37bba5ca-f7bc-478a-bd26-1a826846bf9d req-5aa45c96-c33b-426b-b672-887d6478fda6 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:11.337169 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-37bba5ca-f7bc-478a-bd26-1a826846bf9d req-5aa45c96-c33b-426b-b672-887d6478fda6 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:11.337648 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-37bba5ca-f7bc-478a-bd26-1a826846bf9d req-5aa45c96-c33b-426b-b672-887d6478fda6 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:11.349858 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-37bba5ca-f7bc-478a-bd26-1a826846bf9d req-5aa45c96-c33b-426b-b672-887d6478fda6 service nova] Creating event network-changed:1c042378-ea6a-4e4d-a088-c806fdfbe4e9 for instance 3aa512f7-4b23-46bf-aa72-a3f72f2e122f on hv-cinder-85200 Aug 10 13:42:11.355406 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-37bba5ca-f7bc-478a-bd26-1a826846bf9d req-5aa45c96-c33b-426b-b672-887d6478fda6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042404 Aug 10 13:42:11.356601 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 311/591] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:42:11.442860 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-03939806-d3d6-4e97-82c9-f8b91712138d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:11.443560 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-03939806-d3d6-4e97-82c9-f8b91712138d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 160c89f2-984e-472a-8963-eeefb63824b1] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:11.450744 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-03939806-d3d6-4e97-82c9-f8b91712138d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:11.451228 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-03939806-d3d6-4e97-82c9-f8b91712138d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:11.451851 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-03939806-d3d6-4e97-82c9-f8b91712138d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:11.452774 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-03939806-d3d6-4e97-82c9-f8b91712138d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:11.453166 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-03939806-d3d6-4e97-82c9-f8b91712138d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:11.453722 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-03939806-d3d6-4e97-82c9-f8b91712138d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:11.763307 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-03939806-d3d6-4e97-82c9-f8b91712138d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:11.771268 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-03939806-d3d6-4e97-82c9-f8b91712138d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1" status: 200 len: 1265 microversion: 2.1 time: 0.333253 Aug 10 13:42:11.771851 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 281/592] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:11 2022] GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1 => generated 1265 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:11.999134 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-9c6802da-6136-40ea-b6cf-28858c468485 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:11.999827 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-9c6802da-6136-40ea-b6cf-28858c468485 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:12.006891 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9c6802da-6136-40ea-b6cf-28858c468485 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:12.007377 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9c6802da-6136-40ea-b6cf-28858c468485 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:12.007811 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9c6802da-6136-40ea-b6cf-28858c468485 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:12.008502 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9c6802da-6136-40ea-b6cf-28858c468485 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:12.008957 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9c6802da-6136-40ea-b6cf-28858c468485 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:12.009406 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9c6802da-6136-40ea-b6cf-28858c468485 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:12.141193 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-9c6802da-6136-40ea-b6cf-28858c468485 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:12.149069 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-9c6802da-6136-40ea-b6cf-28858c468485 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:12.150575 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-9c6802da-6136-40ea-b6cf-28858c468485 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:12.151670 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-9c6802da-6136-40ea-b6cf-28858c468485 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1407 microversion: 2.20 time: 0.157293 Aug 10 13:42:12.152229 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 312/593] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:42:11 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:42:12.792435 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-900899f9-481e-4763-b629-eac980d55944 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:12.793706 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-900899f9-481e-4763-b629-eac980d55944 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 160c89f2-984e-472a-8963-eeefb63824b1] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:12.801779 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-900899f9-481e-4763-b629-eac980d55944 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:12.802319 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-900899f9-481e-4763-b629-eac980d55944 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:12.802721 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-900899f9-481e-4763-b629-eac980d55944 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:12.803657 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-900899f9-481e-4763-b629-eac980d55944 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:12.804120 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-900899f9-481e-4763-b629-eac980d55944 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:12.805032 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-900899f9-481e-4763-b629-eac980d55944 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:12.943587 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-900899f9-481e-4763-b629-eac980d55944 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:12.951090 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-900899f9-481e-4763-b629-eac980d55944 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1" status: 200 len: 1265 microversion: 2.1 time: 0.162541 Aug 10 13:42:12.951661 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 282/594] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:12 2022] GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:13.174457 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-175fc717-2de3-4b1e-bfd4-c4ed600b69a7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:13.175716 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-175fc717-2de3-4b1e-bfd4-c4ed600b69a7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:13.183415 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-175fc717-2de3-4b1e-bfd4-c4ed600b69a7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:13.183956 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-175fc717-2de3-4b1e-bfd4-c4ed600b69a7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:13.184522 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-175fc717-2de3-4b1e-bfd4-c4ed600b69a7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:13.185341 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-175fc717-2de3-4b1e-bfd4-c4ed600b69a7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:13.186193 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-175fc717-2de3-4b1e-bfd4-c4ed600b69a7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:13.186825 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-175fc717-2de3-4b1e-bfd4-c4ed600b69a7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:13.432815 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-175fc717-2de3-4b1e-bfd4-c4ed600b69a7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:13.442785 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-175fc717-2de3-4b1e-bfd4-c4ed600b69a7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:13.445064 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-175fc717-2de3-4b1e-bfd4-c4ed600b69a7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:13.446393 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-175fc717-2de3-4b1e-bfd4-c4ed600b69a7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1407 microversion: 2.20 time: 0.276279 Aug 10 13:42:13.447135 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 313/595] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:42:13 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1407 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:42:13.972839 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-3f319d7b-2783-431c-b5a7-178bd28ec18b tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:13.973485 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-3f319d7b-2783-431c-b5a7-178bd28ec18b tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 160c89f2-984e-472a-8963-eeefb63824b1] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:13.981015 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3f319d7b-2783-431c-b5a7-178bd28ec18b tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:13.981579 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3f319d7b-2783-431c-b5a7-178bd28ec18b tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:13.982014 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3f319d7b-2783-431c-b5a7-178bd28ec18b tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:13.982719 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3f319d7b-2783-431c-b5a7-178bd28ec18b tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:13.983171 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3f319d7b-2783-431c-b5a7-178bd28ec18b tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:13.983595 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3f319d7b-2783-431c-b5a7-178bd28ec18b tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:14.158363 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-3f319d7b-2783-431c-b5a7-178bd28ec18b tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:14.172812 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-3f319d7b-2783-431c-b5a7-178bd28ec18b tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1" status: 200 len: 1265 microversion: 2.1 time: 0.203626 Aug 10 13:42:14.173867 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 283/596] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:13 2022] GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1 => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:14.483247 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-e7111f6c-90be-4369-8eda-9714dd653703 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:14.484315 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-e7111f6c-90be-4369-8eda-9714dd653703 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:14.493151 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e7111f6c-90be-4369-8eda-9714dd653703 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:14.493735 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e7111f6c-90be-4369-8eda-9714dd653703 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:14.494173 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e7111f6c-90be-4369-8eda-9714dd653703 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:14.494874 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e7111f6c-90be-4369-8eda-9714dd653703 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:14.495326 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e7111f6c-90be-4369-8eda-9714dd653703 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:14.495753 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e7111f6c-90be-4369-8eda-9714dd653703 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:14.645399 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-e7111f6c-90be-4369-8eda-9714dd653703 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:14.653919 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-e7111f6c-90be-4369-8eda-9714dd653703 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:14.655534 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-e7111f6c-90be-4369-8eda-9714dd653703 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:14.656709 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-e7111f6c-90be-4369-8eda-9714dd653703 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1407 microversion: 2.20 time: 0.178608 Aug 10 13:42:14.657329 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 314/597] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:42:14 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:42:15.200871 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-b7f6de7b-86e5-4ba5-a98a-75b8298018d0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:15.201535 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-b7f6de7b-86e5-4ba5-a98a-75b8298018d0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 160c89f2-984e-472a-8963-eeefb63824b1] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:15.211751 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b7f6de7b-86e5-4ba5-a98a-75b8298018d0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:15.212254 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b7f6de7b-86e5-4ba5-a98a-75b8298018d0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:15.212699 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b7f6de7b-86e5-4ba5-a98a-75b8298018d0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:15.213442 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b7f6de7b-86e5-4ba5-a98a-75b8298018d0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:15.213904 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b7f6de7b-86e5-4ba5-a98a-75b8298018d0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:15.214332 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b7f6de7b-86e5-4ba5-a98a-75b8298018d0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:15.389836 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-b7f6de7b-86e5-4ba5-a98a-75b8298018d0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:15.399927 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-b7f6de7b-86e5-4ba5-a98a-75b8298018d0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1" status: 200 len: 1265 microversion: 2.1 time: 0.203033 Aug 10 13:42:15.400549 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 284/598] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:15 2022] GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1 => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:42:15.682858 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-29fa4025-5401-46a9-81c6-1d76c5106932 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:15.683779 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-29fa4025-5401-46a9-81c6-1d76c5106932 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:15.692672 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-29fa4025-5401-46a9-81c6-1d76c5106932 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:15.693181 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-29fa4025-5401-46a9-81c6-1d76c5106932 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:15.693641 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-29fa4025-5401-46a9-81c6-1d76c5106932 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:15.694351 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-29fa4025-5401-46a9-81c6-1d76c5106932 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:15.694910 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-29fa4025-5401-46a9-81c6-1d76c5106932 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:15.695276 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-29fa4025-5401-46a9-81c6-1d76c5106932 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:15.894003 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-29fa4025-5401-46a9-81c6-1d76c5106932 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:15.911855 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-29fa4025-5401-46a9-81c6-1d76c5106932 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:15.914388 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-29fa4025-5401-46a9-81c6-1d76c5106932 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:15.916130 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-29fa4025-5401-46a9-81c6-1d76c5106932 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1407 microversion: 2.20 time: 0.239740 Aug 10 13:42:15.926616 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 315/599] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:42:15 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:42:16.153622 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-8fbcd100-14f6-490a-b525-9111d5e4c22b req-3c8c2675-8536-437f-a9ab-02c3f71406ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa512f7-4b23-46bf-aa72-a3f72f2e122f", "name": "network-vif-plugged", "status": "completed", "tag": "1c042378-ea6a-4e4d-a088-c806fdfbe4e9"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:42:16.163666 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-8fbcd100-14f6-490a-b525-9111d5e4c22b req-3c8c2675-8536-437f-a9ab-02c3f71406ad service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:16.164109 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-8fbcd100-14f6-490a-b525-9111d5e4c22b req-3c8c2675-8536-437f-a9ab-02c3f71406ad service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:16.164600 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-8fbcd100-14f6-490a-b525-9111d5e4c22b req-3c8c2675-8536-437f-a9ab-02c3f71406ad service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:16.177534 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-8fbcd100-14f6-490a-b525-9111d5e4c22b req-3c8c2675-8536-437f-a9ab-02c3f71406ad service nova] Creating event network-vif-plugged:1c042378-ea6a-4e4d-a088-c806fdfbe4e9 for instance 3aa512f7-4b23-46bf-aa72-a3f72f2e122f on hv-cinder-85200 Aug 10 13:42:16.183943 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-8fbcd100-14f6-490a-b525-9111d5e4c22b req-3c8c2675-8536-437f-a9ab-02c3f71406ad service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034093 Aug 10 13:42:16.185189 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 285/600] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:42:16.423472 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-fbe9d841-9c3a-40fb-9d0f-a806aa67b4b9 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:16.424356 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-fbe9d841-9c3a-40fb-9d0f-a806aa67b4b9 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 160c89f2-984e-472a-8963-eeefb63824b1] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:16.430663 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fbe9d841-9c3a-40fb-9d0f-a806aa67b4b9 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:16.431111 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fbe9d841-9c3a-40fb-9d0f-a806aa67b4b9 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:16.431543 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fbe9d841-9c3a-40fb-9d0f-a806aa67b4b9 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:16.432273 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fbe9d841-9c3a-40fb-9d0f-a806aa67b4b9 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:16.432722 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fbe9d841-9c3a-40fb-9d0f-a806aa67b4b9 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:16.433161 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fbe9d841-9c3a-40fb-9d0f-a806aa67b4b9 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:16.568136 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-fbe9d841-9c3a-40fb-9d0f-a806aa67b4b9 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:16.570479 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:42:16.579057 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-fbe9d841-9c3a-40fb-9d0f-a806aa67b4b9 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1" status: 200 len: 1265 microversion: 2.1 time: 0.159434 Aug 10 13:42:16.579671 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 316/601] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:16 2022] GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:16.950913 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-c200efe5-eb3c-42e2-ad0f-d5a75475033d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:16.951611 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-c200efe5-eb3c-42e2-ad0f-d5a75475033d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:16.954095 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:42:16.959146 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c200efe5-eb3c-42e2-ad0f-d5a75475033d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:16.959638 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c200efe5-eb3c-42e2-ad0f-d5a75475033d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:16.960076 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c200efe5-eb3c-42e2-ad0f-d5a75475033d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:16.960773 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c200efe5-eb3c-42e2-ad0f-d5a75475033d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:16.961259 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c200efe5-eb3c-42e2-ad0f-d5a75475033d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:16.961677 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c200efe5-eb3c-42e2-ad0f-d5a75475033d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:17.114668 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-c200efe5-eb3c-42e2-ad0f-d5a75475033d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:17.122826 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-c200efe5-eb3c-42e2-ad0f-d5a75475033d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:17.124355 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-c200efe5-eb3c-42e2-ad0f-d5a75475033d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:17.125646 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-c200efe5-eb3c-42e2-ad0f-d5a75475033d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1407 microversion: 2.20 time: 0.179428 Aug 10 13:42:17.126203 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 286/602] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:42:16 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:42:17.601537 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-47e46f1c-9083-4067-942f-629d4774f4d4 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:17.602253 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-47e46f1c-9083-4067-942f-629d4774f4d4 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 160c89f2-984e-472a-8963-eeefb63824b1] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:17.610734 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-47e46f1c-9083-4067-942f-629d4774f4d4 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:17.611180 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-47e46f1c-9083-4067-942f-629d4774f4d4 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:17.611633 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-47e46f1c-9083-4067-942f-629d4774f4d4 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:17.612363 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-47e46f1c-9083-4067-942f-629d4774f4d4 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:17.613113 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-47e46f1c-9083-4067-942f-629d4774f4d4 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:17.613629 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-47e46f1c-9083-4067-942f-629d4774f4d4 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:17.741147 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell0:SELECT=2 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:42:17.764618 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-47e46f1c-9083-4067-942f-629d4774f4d4 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:17.772805 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-47e46f1c-9083-4067-942f-629d4774f4d4 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1" status: 200 len: 1265 microversion: 2.1 time: 0.176375 Aug 10 13:42:17.776271 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 317/603] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:17 2022] GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:18.148150 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-0431d4f0-65da-4c8e-984c-7af19e132418 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:18.148837 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-0431d4f0-65da-4c8e-984c-7af19e132418 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:18.157167 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0431d4f0-65da-4c8e-984c-7af19e132418 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:18.157703 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0431d4f0-65da-4c8e-984c-7af19e132418 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:18.158132 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0431d4f0-65da-4c8e-984c-7af19e132418 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:18.158829 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0431d4f0-65da-4c8e-984c-7af19e132418 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:18.159407 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0431d4f0-65da-4c8e-984c-7af19e132418 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:18.159835 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0431d4f0-65da-4c8e-984c-7af19e132418 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:18.296670 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-0431d4f0-65da-4c8e-984c-7af19e132418 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:18.305182 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-0431d4f0-65da-4c8e-984c-7af19e132418 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:18.306725 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-0431d4f0-65da-4c8e-984c-7af19e132418 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:18.307842 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-0431d4f0-65da-4c8e-984c-7af19e132418 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1407 microversion: 2.20 time: 0.163687 Aug 10 13:42:18.308400 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 287/604] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:42:18 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:42:18.793959 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-e24f74d9-d99a-451b-9c92-663bad4787b6 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:18.794593 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-e24f74d9-d99a-451b-9c92-663bad4787b6 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 160c89f2-984e-472a-8963-eeefb63824b1] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:18.797650 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell0:SELECT=14 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:42:18.802171 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e24f74d9-d99a-451b-9c92-663bad4787b6 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:18.802683 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e24f74d9-d99a-451b-9c92-663bad4787b6 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:18.803116 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e24f74d9-d99a-451b-9c92-663bad4787b6 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:18.803856 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e24f74d9-d99a-451b-9c92-663bad4787b6 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:18.804306 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e24f74d9-d99a-451b-9c92-663bad4787b6 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:18.804726 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e24f74d9-d99a-451b-9c92-663bad4787b6 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:18.947270 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-e24f74d9-d99a-451b-9c92-663bad4787b6 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:18.955023 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-e24f74d9-d99a-451b-9c92-663bad4787b6 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1" status: 200 len: 1265 microversion: 2.1 time: 0.164908 Aug 10 13:42:18.955606 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 318/605] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:18 2022] GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:19.330328 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-396f4296-4fc4-432c-b77b-f7a12a91c56c tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:19.330924 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-396f4296-4fc4-432c-b77b-f7a12a91c56c tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:19.333223 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell0:SELECT=2 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:42:19.333891 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell0:SELECT=6 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:42:19.340107 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-396f4296-4fc4-432c-b77b-f7a12a91c56c tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:19.340599 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-396f4296-4fc4-432c-b77b-f7a12a91c56c tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:19.341035 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-396f4296-4fc4-432c-b77b-f7a12a91c56c tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:19.341762 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-396f4296-4fc4-432c-b77b-f7a12a91c56c tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:19.342214 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-396f4296-4fc4-432c-b77b-f7a12a91c56c tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:19.342634 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-396f4296-4fc4-432c-b77b-f7a12a91c56c tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:19.493018 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-396f4296-4fc4-432c-b77b-f7a12a91c56c tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:19.501276 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-396f4296-4fc4-432c-b77b-f7a12a91c56c tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:19.502784 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-396f4296-4fc4-432c-b77b-f7a12a91c56c tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:19.503957 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-396f4296-4fc4-432c-b77b-f7a12a91c56c tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1598 microversion: 2.20 time: 0.177678 Aug 10 13:42:19.504524 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 288/606] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:42:19 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1598 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:42:19.527398 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-8c6d4856-1a13-480d-ba52-525d2f06077f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:19.527799 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-8c6d4856-1a13-480d-ba52-525d2f06077f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:19.534865 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8c6d4856-1a13-480d-ba52-525d2f06077f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:19.535357 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8c6d4856-1a13-480d-ba52-525d2f06077f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:19.535782 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8c6d4856-1a13-480d-ba52-525d2f06077f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:19.536485 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8c6d4856-1a13-480d-ba52-525d2f06077f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:19.536951 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8c6d4856-1a13-480d-ba52-525d2f06077f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:19.537444 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8c6d4856-1a13-480d-ba52-525d2f06077f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:19.621384 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-8c6d4856-1a13-480d-ba52-525d2f06077f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.098004 Aug 10 13:42:19.622146 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 319/607] 10.222.0.52 () {60 vars in 1316 bytes} [Wed Aug 10 13:42:19 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 13:42:19.976165 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-8f92955a-51bd-4ea9-b0ab-8b42f0af7a6f tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:19.977017 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-8f92955a-51bd-4ea9-b0ab-8b42f0af7a6f tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 160c89f2-984e-472a-8963-eeefb63824b1] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:19.984460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8f92955a-51bd-4ea9-b0ab-8b42f0af7a6f tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:19.984943 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8f92955a-51bd-4ea9-b0ab-8b42f0af7a6f tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:19.985406 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8f92955a-51bd-4ea9-b0ab-8b42f0af7a6f tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:19.986111 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8f92955a-51bd-4ea9-b0ab-8b42f0af7a6f tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:19.986563 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8f92955a-51bd-4ea9-b0ab-8b42f0af7a6f tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:19.986977 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8f92955a-51bd-4ea9-b0ab-8b42f0af7a6f tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:20.197526 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-8f92955a-51bd-4ea9-b0ab-8b42f0af7a6f tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:20.208296 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-8f92955a-51bd-4ea9-b0ab-8b42f0af7a6f tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1" status: 200 len: 1265 microversion: 2.1 time: 0.235940 Aug 10 13:42:20.209110 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 289/608] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:19 2022] GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1 => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:42:20.713830 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-56316641-897b-482d-bd98-5e76e9bd3aac req-70aa4747-28e3-4f2a-ab67-c1e316fa5231 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aa512f7-4b23-46bf-aa72-a3f72f2e122f", "tag": "1c042378-ea6a-4e4d-a088-c806fdfbe4e9"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:42:20.723769 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-56316641-897b-482d-bd98-5e76e9bd3aac req-70aa4747-28e3-4f2a-ab67-c1e316fa5231 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:20.724242 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-56316641-897b-482d-bd98-5e76e9bd3aac req-70aa4747-28e3-4f2a-ab67-c1e316fa5231 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:20.724901 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-56316641-897b-482d-bd98-5e76e9bd3aac req-70aa4747-28e3-4f2a-ab67-c1e316fa5231 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:20.737053 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-56316641-897b-482d-bd98-5e76e9bd3aac req-70aa4747-28e3-4f2a-ab67-c1e316fa5231 service nova] Creating event network-changed:1c042378-ea6a-4e4d-a088-c806fdfbe4e9 for instance 3aa512f7-4b23-46bf-aa72-a3f72f2e122f on hv-cinder-85200 Aug 10 13:42:20.742493 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-56316641-897b-482d-bd98-5e76e9bd3aac req-70aa4747-28e3-4f2a-ab67-c1e316fa5231 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032791 Aug 10 13:42:20.743116 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 320/609] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:42:20.936141 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-97be018e-fa1a-4a49-b935-5f99f66c46a6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:20.937122 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-97be018e-fa1a-4a49-b935-5f99f66c46a6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:20.944067 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-97be018e-fa1a-4a49-b935-5f99f66c46a6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:20.945291 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-97be018e-fa1a-4a49-b935-5f99f66c46a6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:20.945291 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-97be018e-fa1a-4a49-b935-5f99f66c46a6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:20.945896 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-97be018e-fa1a-4a49-b935-5f99f66c46a6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:20.946357 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-97be018e-fa1a-4a49-b935-5f99f66c46a6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:20.946783 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-97be018e-fa1a-4a49-b935-5f99f66c46a6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:20.952015 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell1:SELECT=100 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:42:21.034107 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.objects.instance [None req-97be018e-fa1a-4a49-b935-5f99f66c46a6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lazy-loading 'services' on Instance uuid 51cd434d-31c3-4588-aed7-48e7130c5131 {{(pid=129523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:42:21.120156 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-97be018e-fa1a-4a49-b935-5f99f66c46a6 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "DELETE /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131/os-volume_attachments/c17ef3e5-dc53-48b9-87cb-908c33ddad66" status: 202 len: 0 microversion: 2.1 time: 0.187642 Aug 10 13:42:21.121113 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 290/610] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Aug 10 13:42:20 2022] DELETE /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131/os-volume_attachments/c17ef3e5-dc53-48b9-87cb-908c33ddad66 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:42:21.130866 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-341835a3-2c95-44fa-a508-5b0c6693c52f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:21.133149 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-341835a3-2c95-44fa-a508-5b0c6693c52f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:21.145661 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-341835a3-2c95-44fa-a508-5b0c6693c52f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:21.146159 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-341835a3-2c95-44fa-a508-5b0c6693c52f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:21.146596 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-341835a3-2c95-44fa-a508-5b0c6693c52f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:21.147297 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-341835a3-2c95-44fa-a508-5b0c6693c52f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:21.147746 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-341835a3-2c95-44fa-a508-5b0c6693c52f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:21.150454 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-341835a3-2c95-44fa-a508-5b0c6693c52f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:21.203717 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-341835a3-2c95-44fa-a508-5b0c6693c52f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077431 Aug 10 13:42:21.204640 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 321/611] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 10 13:42:21 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:42:21.229808 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-a9033cdc-5144-487f-aeb0-e6c4c27a0da1 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:21.230513 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-a9033cdc-5144-487f-aeb0-e6c4c27a0da1 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 160c89f2-984e-472a-8963-eeefb63824b1] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:21.240603 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a9033cdc-5144-487f-aeb0-e6c4c27a0da1 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:21.241099 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a9033cdc-5144-487f-aeb0-e6c4c27a0da1 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:21.241598 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a9033cdc-5144-487f-aeb0-e6c4c27a0da1 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:21.242363 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a9033cdc-5144-487f-aeb0-e6c4c27a0da1 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:21.242813 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a9033cdc-5144-487f-aeb0-e6c4c27a0da1 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:21.243235 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a9033cdc-5144-487f-aeb0-e6c4c27a0da1 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:21.398126 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-a9033cdc-5144-487f-aeb0-e6c4c27a0da1 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:21.405916 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-a9033cdc-5144-487f-aeb0-e6c4c27a0da1 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1" status: 200 len: 1265 microversion: 2.1 time: 0.180246 Aug 10 13:42:21.406528 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 291/612] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:21 2022] GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:22.216147 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-e1940c75-9945-4bc6-bfc8-344691135200 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:22.218379 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-e1940c75-9945-4bc6-bfc8-344691135200 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:22.226621 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e1940c75-9945-4bc6-bfc8-344691135200 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:22.226912 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e1940c75-9945-4bc6-bfc8-344691135200 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:22.227341 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e1940c75-9945-4bc6-bfc8-344691135200 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:22.228059 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e1940c75-9945-4bc6-bfc8-344691135200 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:22.228507 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e1940c75-9945-4bc6-bfc8-344691135200 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:22.228939 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e1940c75-9945-4bc6-bfc8-344691135200 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:22.258604 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-e1940c75-9945-4bc6-bfc8-344691135200 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046339 Aug 10 13:42:22.259165 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 322/613] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 10 13:42:22 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 13:42:22.339200 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-83c01f7c-3196-4e1c-941f-f0fc198cbc38 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:22.340181 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-83c01f7c-3196-4e1c-941f-f0fc198cbc38 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:22.347193 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-83c01f7c-3196-4e1c-941f-f0fc198cbc38 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:22.347679 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-83c01f7c-3196-4e1c-941f-f0fc198cbc38 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:22.348113 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-83c01f7c-3196-4e1c-941f-f0fc198cbc38 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:22.348800 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-83c01f7c-3196-4e1c-941f-f0fc198cbc38 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:22.349282 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-83c01f7c-3196-4e1c-941f-f0fc198cbc38 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:22.349706 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-83c01f7c-3196-4e1c-941f-f0fc198cbc38 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:22.375606 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-83c01f7c-3196-4e1c-941f-f0fc198cbc38 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Going to try to terminate instance {{(pid=129523) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:42:22.426997 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-c932e9c4-5dcf-443e-83b1-5052414bdc6d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:22.427860 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-c932e9c4-5dcf-443e-83b1-5052414bdc6d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 160c89f2-984e-472a-8963-eeefb63824b1] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:22.434158 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c932e9c4-5dcf-443e-83b1-5052414bdc6d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:22.434762 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c932e9c4-5dcf-443e-83b1-5052414bdc6d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:22.435259 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c932e9c4-5dcf-443e-83b1-5052414bdc6d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:22.436037 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c932e9c4-5dcf-443e-83b1-5052414bdc6d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:22.436548 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c932e9c4-5dcf-443e-83b1-5052414bdc6d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:22.437035 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c932e9c4-5dcf-443e-83b1-5052414bdc6d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:22.455999 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-83c01f7c-3196-4e1c-941f-f0fc198cbc38 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "DELETE /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 204 len: 0 microversion: 2.1 time: 0.120208 Aug 10 13:42:22.459199 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 292/614] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 10 13:42:22 2022] DELETE /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:42:22.468337 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-6f53b5b0-9df8-4a6a-88cc-ff8ac6e12bb8 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:22.469614 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-6f53b5b0-9df8-4a6a-88cc-ff8ac6e12bb8 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:22.476375 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6f53b5b0-9df8-4a6a-88cc-ff8ac6e12bb8 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:22.476861 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6f53b5b0-9df8-4a6a-88cc-ff8ac6e12bb8 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:22.477313 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6f53b5b0-9df8-4a6a-88cc-ff8ac6e12bb8 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:22.478049 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6f53b5b0-9df8-4a6a-88cc-ff8ac6e12bb8 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:22.478502 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6f53b5b0-9df8-4a6a-88cc-ff8ac6e12bb8 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:22.478913 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6f53b5b0-9df8-4a6a-88cc-ff8ac6e12bb8 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:22.585807 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-c932e9c4-5dcf-443e-83b1-5052414bdc6d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:22.595202 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-c932e9c4-5dcf-443e-83b1-5052414bdc6d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1" status: 200 len: 1265 microversion: 2.1 time: 0.170887 Aug 10 13:42:22.595717 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 323/615] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:22 2022] GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:42:22.621642 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-6f53b5b0-9df8-4a6a-88cc-ff8ac6e12bb8 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:22.629610 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-6f53b5b0-9df8-4a6a-88cc-ff8ac6e12bb8 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1689 microversion: 2.1 time: 0.166615 Aug 10 13:42:22.630366 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 293/616] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:22 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:23.615764 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-bad6149a-0e08-4141-b9ea-6b4d7fdb101a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:23.616311 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-bad6149a-0e08-4141-b9ea-6b4d7fdb101a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 160c89f2-984e-472a-8963-eeefb63824b1] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:23.622676 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-bad6149a-0e08-4141-b9ea-6b4d7fdb101a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:23.623155 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-bad6149a-0e08-4141-b9ea-6b4d7fdb101a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:23.623620 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-bad6149a-0e08-4141-b9ea-6b4d7fdb101a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:23.624311 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-bad6149a-0e08-4141-b9ea-6b4d7fdb101a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:23.624768 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-bad6149a-0e08-4141-b9ea-6b4d7fdb101a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:23.625849 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-bad6149a-0e08-4141-b9ea-6b4d7fdb101a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:23.650413 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-ea065fe6-6714-41b6-817e-7280887fef84 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:23.651011 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-ea065fe6-6714-41b6-817e-7280887fef84 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:23.658870 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ea065fe6-6714-41b6-817e-7280887fef84 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:23.659454 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ea065fe6-6714-41b6-817e-7280887fef84 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:23.659996 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ea065fe6-6714-41b6-817e-7280887fef84 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:23.667588 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ea065fe6-6714-41b6-817e-7280887fef84 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:23.668159 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ea065fe6-6714-41b6-817e-7280887fef84 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:23.668608 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ea065fe6-6714-41b6-817e-7280887fef84 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:23.777896 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-bad6149a-0e08-4141-b9ea-6b4d7fdb101a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:23.786188 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-bad6149a-0e08-4141-b9ea-6b4d7fdb101a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1" status: 200 len: 1265 microversion: 2.1 time: 0.174511 Aug 10 13:42:23.786782 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 324/617] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:23 2022] GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:23.791439 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-31544681-750f-404b-ba19-803fbbed520e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:23.792074 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-31544681-750f-404b-ba19-803fbbed520e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: bfb52e6c-577e-4368-a03e-1be5e40b8e43] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:23.798554 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-31544681-750f-404b-ba19-803fbbed520e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:23.799046 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-31544681-750f-404b-ba19-803fbbed520e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:23.799481 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-31544681-750f-404b-ba19-803fbbed520e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:23.800265 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-31544681-750f-404b-ba19-803fbbed520e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:23.800750 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-31544681-750f-404b-ba19-803fbbed520e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:23.801174 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-31544681-750f-404b-ba19-803fbbed520e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:23.813433 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-ea065fe6-6714-41b6-817e-7280887fef84 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:23.819792 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-ea065fe6-6714-41b6-817e-7280887fef84 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1689 microversion: 2.1 time: 0.173037 Aug 10 13:42:23.822337 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 294/618] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:23 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1689 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:42:23.826995 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-31544681-750f-404b-ba19-803fbbed520e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43/ips" status: 200 len: 151 microversion: 2.1 time: 0.039173 Aug 10 13:42:23.827563 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 325/619] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Aug 10 13:42:23 2022] GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:42:24.177412 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-1e4fec6d-50f4-4109-a5d0-a892ba572d4b req-0fec152d-9c70-41a9-a133-77d36aafe425 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "160c89f2-984e-472a-8963-eeefb63824b1", "name": "network-vif-plugged", "status": "completed", "tag": "6cf489ec-5def-460d-a9f9-421d77157738"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:42:24.188799 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-1e4fec6d-50f4-4109-a5d0-a892ba572d4b req-0fec152d-9c70-41a9-a133-77d36aafe425 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:24.189331 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-1e4fec6d-50f4-4109-a5d0-a892ba572d4b req-0fec152d-9c70-41a9-a133-77d36aafe425 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:24.189749 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-1e4fec6d-50f4-4109-a5d0-a892ba572d4b req-0fec152d-9c70-41a9-a133-77d36aafe425 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:24.201640 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-1e4fec6d-50f4-4109-a5d0-a892ba572d4b req-0fec152d-9c70-41a9-a133-77d36aafe425 service nova] Creating event network-vif-plugged:6cf489ec-5def-460d-a9f9-421d77157738 for instance 160c89f2-984e-472a-8963-eeefb63824b1 on hv-cinder-85200 Aug 10 13:42:24.207278 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-1e4fec6d-50f4-4109-a5d0-a892ba572d4b req-0fec152d-9c70-41a9-a133-77d36aafe425 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033525 Aug 10 13:42:24.208218 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 295/620] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:42:24.807581 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-5a962932-ae71-4640-88bc-a65d40410b5d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:24.808113 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-5a962932-ae71-4640-88bc-a65d40410b5d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 160c89f2-984e-472a-8963-eeefb63824b1] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:24.814772 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5a962932-ae71-4640-88bc-a65d40410b5d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:24.815309 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5a962932-ae71-4640-88bc-a65d40410b5d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:24.815747 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5a962932-ae71-4640-88bc-a65d40410b5d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:24.816462 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5a962932-ae71-4640-88bc-a65d40410b5d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:24.816923 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5a962932-ae71-4640-88bc-a65d40410b5d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:24.817375 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5a962932-ae71-4640-88bc-a65d40410b5d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:24.842256 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-f99784c8-fe03-4a9d-9335-e8dac09dfb8e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:24.842956 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-f99784c8-fe03-4a9d-9335-e8dac09dfb8e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:24.849950 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f99784c8-fe03-4a9d-9335-e8dac09dfb8e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:24.850439 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f99784c8-fe03-4a9d-9335-e8dac09dfb8e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:24.850963 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f99784c8-fe03-4a9d-9335-e8dac09dfb8e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:24.851838 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f99784c8-fe03-4a9d-9335-e8dac09dfb8e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:24.852152 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f99784c8-fe03-4a9d-9335-e8dac09dfb8e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:24.852549 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f99784c8-fe03-4a9d-9335-e8dac09dfb8e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:24.959081 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-5a962932-ae71-4640-88bc-a65d40410b5d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:24.967049 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-5a962932-ae71-4640-88bc-a65d40410b5d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1" status: 200 len: 1265 microversion: 2.1 time: 0.163344 Aug 10 13:42:24.967640 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 326/621] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:24 2022] GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:25.001610 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-f99784c8-fe03-4a9d-9335-e8dac09dfb8e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:25.009569 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-f99784c8-fe03-4a9d-9335-e8dac09dfb8e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1689 microversion: 2.1 time: 0.171862 Aug 10 13:42:25.010149 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 296/622] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:24 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:42:25.175706 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-c1003bb8-1639-43ea-810a-291a174ac25f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb3126e6-7480-4e47-a917-12113b92a46b"}} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:42:25.178071 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-c1003bb8-1639-43ea-810a-291a174ac25f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: bfb52e6c-577e-4368-a03e-1be5e40b8e43] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:25.184130 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c1003bb8-1639-43ea-810a-291a174ac25f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:25.184615 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c1003bb8-1639-43ea-810a-291a174ac25f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:25.185053 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c1003bb8-1639-43ea-810a-291a174ac25f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:25.185791 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c1003bb8-1639-43ea-810a-291a174ac25f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:25.186300 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c1003bb8-1639-43ea-810a-291a174ac25f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:25.186725 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c1003bb8-1639-43ea-810a-291a174ac25f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:25.988900 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-d6470ac9-694f-42f5-bb35-727e57f1f75d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:25.989619 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-d6470ac9-694f-42f5-bb35-727e57f1f75d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 160c89f2-984e-472a-8963-eeefb63824b1] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:25.996299 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d6470ac9-694f-42f5-bb35-727e57f1f75d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:25.996780 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d6470ac9-694f-42f5-bb35-727e57f1f75d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:25.997205 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d6470ac9-694f-42f5-bb35-727e57f1f75d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:25.997929 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d6470ac9-694f-42f5-bb35-727e57f1f75d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:25.998372 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d6470ac9-694f-42f5-bb35-727e57f1f75d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:25.998786 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d6470ac9-694f-42f5-bb35-727e57f1f75d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:26.142787 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-d6470ac9-694f-42f5-bb35-727e57f1f75d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:26.151483 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-d6470ac9-694f-42f5-bb35-727e57f1f75d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1" status: 200 len: 1265 microversion: 2.1 time: 0.167250 Aug 10 13:42:26.153069 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 297/623] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:25 2022] GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:42:26.160331 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-9b035d57-3a5f-432a-bdf7-fe69db22cbbf tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:26.161362 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-9b035d57-3a5f-432a-bdf7-fe69db22cbbf tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:26.168151 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9b035d57-3a5f-432a-bdf7-fe69db22cbbf tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:26.168687 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9b035d57-3a5f-432a-bdf7-fe69db22cbbf tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:26.169154 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9b035d57-3a5f-432a-bdf7-fe69db22cbbf tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:26.170003 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9b035d57-3a5f-432a-bdf7-fe69db22cbbf tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:26.170542 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9b035d57-3a5f-432a-bdf7-fe69db22cbbf tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:26.170974 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9b035d57-3a5f-432a-bdf7-fe69db22cbbf tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:26.292759 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-c1003bb8-1639-43ea-810a-291a174ac25f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "POST /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.121002 Aug 10 13:42:26.301415 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 327/624] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 10 13:42:25 2022] POST /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43/os-volume_attachments => generated 194 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:42:26.332537 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-9b035d57-3a5f-432a-bdf7-fe69db22cbbf tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:26.342793 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-9b035d57-3a5f-432a-bdf7-fe69db22cbbf tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1689 microversion: 2.1 time: 0.188084 Aug 10 13:42:26.343782 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 298/625] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:26 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1689 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:27.177328 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-07a6ebe8-51b8-4c3f-9d6f-46331d888462 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:27.178979 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-07a6ebe8-51b8-4c3f-9d6f-46331d888462 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 160c89f2-984e-472a-8963-eeefb63824b1] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:27.194581 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-07a6ebe8-51b8-4c3f-9d6f-46331d888462 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:27.194581 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-07a6ebe8-51b8-4c3f-9d6f-46331d888462 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:27.195114 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-07a6ebe8-51b8-4c3f-9d6f-46331d888462 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:27.196735 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-07a6ebe8-51b8-4c3f-9d6f-46331d888462 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:27.197876 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-07a6ebe8-51b8-4c3f-9d6f-46331d888462 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:27.198546 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-07a6ebe8-51b8-4c3f-9d6f-46331d888462 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:27.351419 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-07a6ebe8-51b8-4c3f-9d6f-46331d888462 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:27.360566 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-07a6ebe8-51b8-4c3f-9d6f-46331d888462 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1" status: 200 len: 1265 microversion: 2.1 time: 0.188510 Aug 10 13:42:27.366145 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-f07d2de3-aef3-40ed-8ca7-4ca730125036 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:27.366816 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-f07d2de3-aef3-40ed-8ca7-4ca730125036 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:27.370193 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 328/626] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:27 2022] GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1 => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:27.373332 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f07d2de3-aef3-40ed-8ca7-4ca730125036 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:27.373822 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f07d2de3-aef3-40ed-8ca7-4ca730125036 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:27.374248 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f07d2de3-aef3-40ed-8ca7-4ca730125036 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:27.375036 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f07d2de3-aef3-40ed-8ca7-4ca730125036 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:27.375501 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f07d2de3-aef3-40ed-8ca7-4ca730125036 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:27.375921 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f07d2de3-aef3-40ed-8ca7-4ca730125036 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:27.673833 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-f07d2de3-aef3-40ed-8ca7-4ca730125036 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:27.681947 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-f07d2de3-aef3-40ed-8ca7-4ca730125036 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1621 microversion: 2.1 time: 0.319517 Aug 10 13:42:27.682309 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 299/627] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:27 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1621 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:42:27.743337 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-a09908ad-8636-4d5d-84d0-5a6be6358626 req-c5f0b0ca-0faa-4642-833a-0677f2a5a408 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51cd434d-31c3-4588-aed7-48e7130c5131", "name": "network-vif-deleted", "tag": "514f1eb9-5330-47e3-b4c5-db965c497335"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:42:27.754534 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-a09908ad-8636-4d5d-84d0-5a6be6358626 req-c5f0b0ca-0faa-4642-833a-0677f2a5a408 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:27.755224 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-a09908ad-8636-4d5d-84d0-5a6be6358626 req-c5f0b0ca-0faa-4642-833a-0677f2a5a408 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:27.755895 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-a09908ad-8636-4d5d-84d0-5a6be6358626 req-c5f0b0ca-0faa-4642-833a-0677f2a5a408 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:27.769382 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-a09908ad-8636-4d5d-84d0-5a6be6358626 req-c5f0b0ca-0faa-4642-833a-0677f2a5a408 service nova] Creating event network-vif-deleted:514f1eb9-5330-47e3-b4c5-db965c497335 for instance 51cd434d-31c3-4588-aed7-48e7130c5131 on hv-cinder-85200 Aug 10 13:42:27.774742 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-a09908ad-8636-4d5d-84d0-5a6be6358626 req-c5f0b0ca-0faa-4642-833a-0677f2a5a408 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034764 Aug 10 13:42:27.778600 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 329/628] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:42:28.395393 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-ea6062b8-df51-4167-a87a-d9733056a7d6 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:28.396068 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-ea6062b8-df51-4167-a87a-d9733056a7d6 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 160c89f2-984e-472a-8963-eeefb63824b1] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:28.405686 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ea6062b8-df51-4167-a87a-d9733056a7d6 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:28.406684 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ea6062b8-df51-4167-a87a-d9733056a7d6 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:28.407601 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ea6062b8-df51-4167-a87a-d9733056a7d6 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:28.408316 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ea6062b8-df51-4167-a87a-d9733056a7d6 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:28.408768 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ea6062b8-df51-4167-a87a-d9733056a7d6 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:28.409610 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ea6062b8-df51-4167-a87a-d9733056a7d6 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:28.557785 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-ea6062b8-df51-4167-a87a-d9733056a7d6 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:28.566156 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-ea6062b8-df51-4167-a87a-d9733056a7d6 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1" status: 200 len: 1453 microversion: 2.1 time: 0.177079 Aug 10 13:42:28.566810 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 300/629] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:28 2022] GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1 => generated 1453 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:28.592199 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-aa101bc8-610a-414e-b180-3e8568c3499b tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:28.592984 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-aa101bc8-610a-414e-b180-3e8568c3499b tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 160c89f2-984e-472a-8963-eeefb63824b1] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:28.599419 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-aa101bc8-610a-414e-b180-3e8568c3499b tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:28.599900 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-aa101bc8-610a-414e-b180-3e8568c3499b tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:28.600575 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-aa101bc8-610a-414e-b180-3e8568c3499b tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:28.601382 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-aa101bc8-610a-414e-b180-3e8568c3499b tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:28.603848 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-aa101bc8-610a-414e-b180-3e8568c3499b tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:28.603848 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-aa101bc8-610a-414e-b180-3e8568c3499b tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:28.703502 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-f9ef9cd5-92da-42aa-99fb-17147c7c5a4d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:28.703999 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-f9ef9cd5-92da-42aa-99fb-17147c7c5a4d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:28.711498 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f9ef9cd5-92da-42aa-99fb-17147c7c5a4d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:28.712234 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f9ef9cd5-92da-42aa-99fb-17147c7c5a4d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:28.712848 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f9ef9cd5-92da-42aa-99fb-17147c7c5a4d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:28.713747 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f9ef9cd5-92da-42aa-99fb-17147c7c5a4d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:28.714356 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f9ef9cd5-92da-42aa-99fb-17147c7c5a4d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:28.714960 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f9ef9cd5-92da-42aa-99fb-17147c7c5a4d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:28.753071 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f9ef9cd5-92da-42aa-99fb-17147c7c5a4d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:28.753822 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f9ef9cd5-92da-42aa-99fb-17147c7c5a4d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:28.754452 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f9ef9cd5-92da-42aa-99fb-17147c7c5a4d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:28.755064 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.objects.instance [None req-f9ef9cd5-92da-42aa-99fb-17147c7c5a4d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lazy-loading 'fault' on Instance uuid 51cd434d-31c3-4588-aed7-48e7130c5131 {{(pid=129523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:42:28.773283 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-aa101bc8-610a-414e-b180-3e8568c3499b tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:28.788091 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-aa101bc8-610a-414e-b180-3e8568c3499b tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1" status: 200 len: 1453 microversion: 2.1 time: 0.200711 Aug 10 13:42:28.788596 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 330/630] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:28 2022] GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1 => generated 1453 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:28.805065 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-f9ef9cd5-92da-42aa-99fb-17147c7c5a4d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:28.815924 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-f9ef9cd5-92da-42aa-99fb-17147c7c5a4d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 200 len: 1335 microversion: 2.1 time: 0.116199 Aug 10 13:42:28.826480 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 301/631] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:28 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 1335 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:42:29.838933 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-baf74be3-f1bd-47e4-8733-9cfebd3fa47b tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:29.839471 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-baf74be3-f1bd-47e4-8733-9cfebd3fa47b tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 51cd434d-31c3-4588-aed7-48e7130c5131] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:29.846035 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-baf74be3-f1bd-47e4-8733-9cfebd3fa47b tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:29.846515 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-baf74be3-f1bd-47e4-8733-9cfebd3fa47b tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:29.846946 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-baf74be3-f1bd-47e4-8733-9cfebd3fa47b tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:29.847634 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-baf74be3-f1bd-47e4-8733-9cfebd3fa47b tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:29.848081 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-baf74be3-f1bd-47e4-8733-9cfebd3fa47b tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:29.848498 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-baf74be3-f1bd-47e4-8733-9cfebd3fa47b tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:29.862313 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.wsgi [None req-baf74be3-f1bd-47e4-8733-9cfebd3fa47b tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] HTTP exception thrown: Instance 51cd434d-31c3-4588-aed7-48e7130c5131 could not be found. Aug 10 13:42:29.864275 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-baf74be3-f1bd-47e4-8733-9cfebd3fa47b tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Request method failure captured: Aug 10 13:42:29.864275 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: request: GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 HTTP/1.1 Aug 10 13:42:29.864275 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept: application/json Aug 10 13:42:29.864275 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept-Encoding: identity Aug 10 13:42:29.864275 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Connection: close Aug 10 13:42:29.864275 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Length: 0 Aug 10 13:42:29.864275 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Type: application/json Aug 10 13:42:29.864275 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Host: 10.222.0.52 Aug 10 13:42:29.864275 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Openstack-System-Scope: None Aug 10 13:42:29.864275 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: User-Agent: python-urllib3/1.26.11 Aug 10 13:42:29.864275 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Auth-Token: gAAAAABi87SyiKkY4w5thpU-lMeFOv-pupV3M4p5O_G9Bq0nw7Mt72anXX_8NpPA6bSBk3F77efaTtx9_wfsx9tfpnDHinM6_nwESAvKYqiVuXh6I6GeGsfaWe_Ya10ueo8dBFFLc_3EiOnm1SU3tp8oyoyNzcvZhdKgk0BRE0yUrE4ibPeYstg Aug 10 13:42:29.864275 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Id: None Aug 10 13:42:29.864275 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Name: None Aug 10 13:42:29.864275 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Identity-Status: Confirmed Aug 10 13:42:29.864275 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Is-Admin-Project: True Aug 10 13:42:29.864275 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Id: default Aug 10 13:42:29.864275 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Name: Default Aug 10 13:42:29.864275 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Id: d8eda7c7d6a348e08e81a6b2496b09e5 Aug 10 13:42:29.864275 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2121919159 Aug 10 13:42:29.864275 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Role: member,reader Aug 10 13:42:29.864275 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Roles: member,reader Aug 10 13:42:29.865908 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d8eda7c7d6a348e08e81a6b2496b09e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d8eda7c7d6a348e08e81a6b2496b09e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d8eda7c7d6a348e08e81a6b2496b09e5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d8eda7c7d6a348e08e81a6b2496b09e5"}]}] Aug 10 13:42:29.865908 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2121919159 Aug 10 13:42:29.865908 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Id: d8eda7c7d6a348e08e81a6b2496b09e5 Aug 10 13:42:29.865908 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2121919159 Aug 10 13:42:29.865908 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User: tempest-ServerRescueNegativeTestJSON-2121919159-project Aug 10 13:42:29.865908 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Id: default Aug 10 13:42:29.865908 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Name: Default Aug 10 13:42:29.865908 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Id: 5573338f0bd64c729c7d89345069ca6f Aug 10 13:42:29.865908 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2121919159-project Aug 10 13:42:29.865908 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: method: > Aug 10 13:42:29.865908 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: exception: Instance 51cd434d-31c3-4588-aed7-48e7130c5131 could not be found. Aug 10 13:42:29.865908 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: action_args: {'id': '51cd434d-31c3-4588-aed7-48e7130c5131'} Aug 10 13:42:29.866813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:42:29.866813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:42:29.866813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:42:29.866813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:42:29.866813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:42:29.866813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:42:29.866813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:42:29.866813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:42:29.866813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:42:29.866813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:42:29.866813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51cd434d-31c3-4588-aed7-48e7130c5131 could not be found. Aug 10 13:42:29.866813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:42:29.866813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:42:29.866813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:42:29.866813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:42:29.866813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:42:29.866813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:42:29.866813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:42:29.866813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:42:29.866813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:42:29.868629 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:42:29.868629 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:42:29.868629 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:42:29.868629 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:42:29.868629 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:42:29.868629 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:42:29.868629 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:42:29.868629 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51cd434d-31c3-4588-aed7-48e7130c5131 could not be found. Aug 10 13:42:29.868629 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:42:29.868629 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:42:29.868629 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:42:29.868629 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:42:29.868629 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:42:29.868629 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:42:29.868629 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:42:29.868629 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:42:29.868629 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51cd434d-31c3-4588-aed7-48e7130c5131 could not be found. Aug 10 13:42:29.868629 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:42:29.870159 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-baf74be3-f1bd-47e4-8733-9cfebd3fa47b tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Returning 404 to user: Instance 51cd434d-31c3-4588-aed7-48e7130c5131 could not be found. {{(pid=129522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:42:29.870159 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-baf74be3-f1bd-47e4-8733-9cfebd3fa47b tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131" status: 404 len: 111 microversion: 2.1 time: 0.030789 Aug 10 13:42:29.870159 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 331/632] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:29 2022] GET /compute/v2.1/servers/51cd434d-31c3-4588-aed7-48e7130c5131 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:42:29.874256 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-256847bb-c6bd-4be2-a201-ce81260c3d07 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '.version_select at 0x7f49c4495550>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:29.897092 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-256847bb-c6bd-4be2-a201-ce81260c3d07 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-766460570" status: 202 len: 0 microversion: 2.1 time: 0.026439 Aug 10 13:42:29.897699 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 302/633] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Aug 10 13:42:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-766460570 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:42:30.512790 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-f8c91404-be8c-46e8-a0e3-9ed9622d7b11 req-efbe46c9-3a47-40da-a804-565c5eb485d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "160c89f2-984e-472a-8963-eeefb63824b1", "tag": "6cf489ec-5def-460d-a9f9-421d77157738"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:42:30.522920 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-f8c91404-be8c-46e8-a0e3-9ed9622d7b11 req-efbe46c9-3a47-40da-a804-565c5eb485d9 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:30.523393 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-f8c91404-be8c-46e8-a0e3-9ed9622d7b11 req-efbe46c9-3a47-40da-a804-565c5eb485d9 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:30.523812 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-f8c91404-be8c-46e8-a0e3-9ed9622d7b11 req-efbe46c9-3a47-40da-a804-565c5eb485d9 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:30.536310 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-f8c91404-be8c-46e8-a0e3-9ed9622d7b11 req-efbe46c9-3a47-40da-a804-565c5eb485d9 service nova] Creating event network-changed:6cf489ec-5def-460d-a9f9-421d77157738 for instance 160c89f2-984e-472a-8963-eeefb63824b1 on hv-cinder-85200 Aug 10 13:42:30.541796 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-f8c91404-be8c-46e8-a0e3-9ed9622d7b11 req-efbe46c9-3a47-40da-a804-565c5eb485d9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033049 Aug 10 13:42:30.543266 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 332/634] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:42:32.894043 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-af13e230-bbf9-4e3a-90e5-70ce482de017 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:32.894601 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-af13e230-bbf9-4e3a-90e5-70ce482de017 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:32.900531 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-af13e230-bbf9-4e3a-90e5-70ce482de017 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:32.901017 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-af13e230-bbf9-4e3a-90e5-70ce482de017 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:32.901492 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-af13e230-bbf9-4e3a-90e5-70ce482de017 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:32.902188 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-af13e230-bbf9-4e3a-90e5-70ce482de017 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:32.902651 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-af13e230-bbf9-4e3a-90e5-70ce482de017 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:32.903080 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-af13e230-bbf9-4e3a-90e5-70ce482de017 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:32.929583 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-af13e230-bbf9-4e3a-90e5-70ce482de017 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Going to try to terminate instance {{(pid=129523) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:42:33.019314 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-af13e230-bbf9-4e3a-90e5-70ce482de017 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "DELETE /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 204 len: 0 microversion: 2.1 time: 0.127881 Aug 10 13:42:33.019314 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 303/635] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 10 13:42:32 2022] DELETE /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:42:33.027795 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-65c37b33-7506-4509-bc25-37e5a3c39f4d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:33.029269 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-65c37b33-7506-4509-bc25-37e5a3c39f4d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:33.036800 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-65c37b33-7506-4509-bc25-37e5a3c39f4d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:33.037332 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-65c37b33-7506-4509-bc25-37e5a3c39f4d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:33.037771 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-65c37b33-7506-4509-bc25-37e5a3c39f4d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:33.038471 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-65c37b33-7506-4509-bc25-37e5a3c39f4d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:33.038923 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-65c37b33-7506-4509-bc25-37e5a3c39f4d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:33.039347 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-65c37b33-7506-4509-bc25-37e5a3c39f4d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:33.256757 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-65c37b33-7506-4509-bc25-37e5a3c39f4d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:33.265218 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-65c37b33-7506-4509-bc25-37e5a3c39f4d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1508 microversion: 2.1 time: 0.242762 Aug 10 13:42:33.265821 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 333/636] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:33 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1508 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:33.893004 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-8152e403-df2d-4793-b61b-0a7119bc5a13 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb3126e6-7480-4e47-a917-12113b92a46b"}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:42:33.895376 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-8152e403-df2d-4793-b61b-0a7119bc5a13 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: bfb52e6c-577e-4368-a03e-1be5e40b8e43] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:33.901750 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8152e403-df2d-4793-b61b-0a7119bc5a13 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:33.902204 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8152e403-df2d-4793-b61b-0a7119bc5a13 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:33.904092 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8152e403-df2d-4793-b61b-0a7119bc5a13 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:33.904092 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8152e403-df2d-4793-b61b-0a7119bc5a13 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:33.904092 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8152e403-df2d-4793-b61b-0a7119bc5a13 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:33.904393 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8152e403-df2d-4793-b61b-0a7119bc5a13 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:33.908088 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:42:34.101540 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.wsgi [None req-8152e403-df2d-4793-b61b-0a7119bc5a13 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] HTTP exception thrown: Invalid volume: volume eb3126e6-7480-4e47-a917-12113b92a46b is already attached to instances: bfb52e6c-577e-4368-a03e-1be5e40b8e43 Aug 10 13:42:34.103238 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-8152e403-df2d-4793-b61b-0a7119bc5a13 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Request method failure captured: Aug 10 13:42:34.103238 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: request: POST /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43/os-volume_attachments HTTP/1.1 Aug 10 13:42:34.103238 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept: application/json Aug 10 13:42:34.103238 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept-Encoding: identity Aug 10 13:42:34.103238 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Connection: close Aug 10 13:42:34.103238 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Length: 74 Aug 10 13:42:34.103238 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Type: application/json Aug 10 13:42:34.103238 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Host: 10.222.0.52 Aug 10 13:42:34.103238 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Openstack-System-Scope: None Aug 10 13:42:34.103238 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: User-Agent: python-urllib3/1.26.11 Aug 10 13:42:34.103238 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Auth-Token: gAAAAABi87Sor1QukN8WwkCMRH0utTzHqdtW9hBypcULvW8_thEN8NIRbRb3dRFY62pVCieUmq7t4p3U1aqc6NH3mLhkTq5eSrbHxF5HfdCRrvoVeQ0o3DpawgBQQZEUeD2RccyRTg2LrZLPb9H0A6tO9wPr-HvRM84fUPq4D0GzK22Ap72p14g Aug 10 13:42:34.103238 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Id: None Aug 10 13:42:34.103238 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Name: None Aug 10 13:42:34.103238 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Identity-Status: Confirmed Aug 10 13:42:34.103238 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Is-Admin-Project: True Aug 10 13:42:34.103238 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Id: default Aug 10 13:42:34.103238 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Name: Default Aug 10 13:42:34.103238 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Id: 48e5556cbbfd4b00aa4f6055cd6238b2 Aug 10 13:42:34.103238 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Name: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:42:34.103238 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Role: member,reader Aug 10 13:42:34.103238 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Roles: member,reader Aug 10 13:42:34.104706 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/48e5556cbbfd4b00aa4f6055cd6238b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48e5556cbbfd4b00aa4f6055cd6238b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_48e5556cbbfd4b00aa4f6055cd6238b2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48e5556cbbfd4b00aa4f6055cd6238b2"}]}] Aug 10 13:42:34.104706 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:42:34.104706 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Id: 48e5556cbbfd4b00aa4f6055cd6238b2 Aug 10 13:42:34.104706 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:42:34.104706 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User: tempest-AttachVolumeNegativeTest-965925392-project Aug 10 13:42:34.104706 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Id: default Aug 10 13:42:34.104706 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Name: Default Aug 10 13:42:34.104706 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Id: a3d9e5dc719c430eac6b5c8d8b814566 Aug 10 13:42:34.104706 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Name: tempest-AttachVolumeNegativeTest-965925392-project Aug 10 13:42:34.104706 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Aug 10 13:42:34.104706 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: {"volumeAttachment": {"volumeId": "eb3126e6-7480-4e47-a917-12113b92a46b"}} Aug 10 13:42:34.104706 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: method: > Aug 10 13:42:34.105480 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: exception: Invalid volume: volume eb3126e6-7480-4e47-a917-12113b92a46b is already attached to instances: bfb52e6c-577e-4368-a03e-1be5e40b8e43 Aug 10 13:42:34.105480 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: action_args: {'server_id': 'bfb52e6c-577e-4368-a03e-1be5e40b8e43', 'body': {'volumeAttachment': {'volumeId': 'eb3126e6-7480-4e47-a917-12113b92a46b'}}} Aug 10 13:42:34.105480 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:42:34.105480 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:42:34.105480 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 13:42:34.105480 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 13:42:34.105480 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 13:42:34.105480 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 13:42:34.105480 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 10 13:42:34.105480 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 13:42:34.105480 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 10 13:42:34.105480 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 10 13:42:34.105480 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 10 13:42:34.105480 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 10 13:42:34.105480 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume eb3126e6-7480-4e47-a917-12113b92a46b is already attached to instances: bfb52e6c-577e-4368-a03e-1be5e40b8e43 Aug 10 13:42:34.105480 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:42:34.105480 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:42:34.105480 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:42:34.105480 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:42:34.106655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:42:34.106655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:42:34.106655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:42:34.106655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:42:34.106655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:42:34.106655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:42:34.106655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 13:42:34.106655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 13:42:34.106655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 13:42:34.106655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 13:42:34.106655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 13:42:34.106655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 13:42:34.106655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 10 13:42:34.106655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 10 13:42:34.106655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume eb3126e6-7480-4e47-a917-12113b92a46b is already attached to instances: bfb52e6c-577e-4368-a03e-1be5e40b8e43 Aug 10 13:42:34.106655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:42:34.106655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:42:34.106655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:42:34.106655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:42:34.106655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:42:34.107809 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:42:34.107809 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:42:34.107809 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:42:34.107809 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume eb3126e6-7480-4e47-a917-12113b92a46b is already attached to instances: bfb52e6c-577e-4368-a03e-1be5e40b8e43 Aug 10 13:42:34.107809 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:42:34.107809 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-8152e403-df2d-4793-b61b-0a7119bc5a13 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Returning 400 to user: Invalid volume: volume eb3126e6-7480-4e47-a917-12113b92a46b is already attached to instances: bfb52e6c-577e-4368-a03e-1be5e40b8e43 {{(pid=129523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:42:34.107809 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-8152e403-df2d-4793-b61b-0a7119bc5a13 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "POST /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.215965 Aug 10 13:42:34.107809 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 304/637] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 10 13:42:33 2022] POST /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43/os-volume_attachments => generated 174 bytes in 217 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 13:42:34.169194 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-c2201adc-1c15-4d1e-91d2-e7193fb0ed5f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:34.169720 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-c2201adc-1c15-4d1e-91d2-e7193fb0ed5f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: bfb52e6c-577e-4368-a03e-1be5e40b8e43] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:34.176551 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c2201adc-1c15-4d1e-91d2-e7193fb0ed5f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:34.177031 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c2201adc-1c15-4d1e-91d2-e7193fb0ed5f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:34.177502 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c2201adc-1c15-4d1e-91d2-e7193fb0ed5f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:34.178187 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c2201adc-1c15-4d1e-91d2-e7193fb0ed5f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:34.178771 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c2201adc-1c15-4d1e-91d2-e7193fb0ed5f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:34.179052 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c2201adc-1c15-4d1e-91d2-e7193fb0ed5f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:34.260022 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.objects.instance [None req-c2201adc-1c15-4d1e-91d2-e7193fb0ed5f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lazy-loading 'services' on Instance uuid bfb52e6c-577e-4368-a03e-1be5e40b8e43 {{(pid=129522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:42:34.286890 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-e054def4-66a1-49a9-9b6a-5054c8469c86 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:34.287531 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-e054def4-66a1-49a9-9b6a-5054c8469c86 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:34.293637 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e054def4-66a1-49a9-9b6a-5054c8469c86 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:34.294115 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e054def4-66a1-49a9-9b6a-5054c8469c86 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:34.294544 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e054def4-66a1-49a9-9b6a-5054c8469c86 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:34.295235 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e054def4-66a1-49a9-9b6a-5054c8469c86 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:34.295691 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e054def4-66a1-49a9-9b6a-5054c8469c86 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:34.296110 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e054def4-66a1-49a9-9b6a-5054c8469c86 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:34.326925 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:42:34.339552 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-c2201adc-1c15-4d1e-91d2-e7193fb0ed5f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43/os-volume_attachments/eb3126e6-7480-4e47-a917-12113b92a46b" status: 202 len: 0 microversion: 2.1 time: 0.174061 Aug 10 13:42:34.340145 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 334/638] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Aug 10 13:42:34 2022] DELETE /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43/os-volume_attachments/eb3126e6-7480-4e47-a917-12113b92a46b => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:42:34.349666 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-ce591d92-ab0d-49ef-9600-132e45bd0827 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:34.351955 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-ce591d92-ab0d-49ef-9600-132e45bd0827 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: bfb52e6c-577e-4368-a03e-1be5e40b8e43] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:34.358682 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ce591d92-ab0d-49ef-9600-132e45bd0827 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:34.359759 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ce591d92-ab0d-49ef-9600-132e45bd0827 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:34.360193 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ce591d92-ab0d-49ef-9600-132e45bd0827 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:34.360887 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ce591d92-ab0d-49ef-9600-132e45bd0827 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:34.361393 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ce591d92-ab0d-49ef-9600-132e45bd0827 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:34.361818 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ce591d92-ab0d-49ef-9600-132e45bd0827 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:34.392261 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-ce591d92-ab0d-49ef-9600-132e45bd0827 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047060 Aug 10 13:42:34.392838 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 335/639] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 10 13:42:34 2022] GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:42:34.443504 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-e054def4-66a1-49a9-9b6a-5054c8469c86 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:34.451037 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-e054def4-66a1-49a9-9b6a-5054c8469c86 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1508 microversion: 2.1 time: 0.167922 Aug 10 13:42:34.451601 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 305/640] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:34 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:42:35.403956 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-d6f838ae-e281-4f62-aba5-2bbbaf2c732e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:35.406117 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-d6f838ae-e281-4f62-aba5-2bbbaf2c732e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: bfb52e6c-577e-4368-a03e-1be5e40b8e43] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:35.412573 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d6f838ae-e281-4f62-aba5-2bbbaf2c732e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:35.413055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d6f838ae-e281-4f62-aba5-2bbbaf2c732e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:35.413610 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d6f838ae-e281-4f62-aba5-2bbbaf2c732e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:35.414295 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d6f838ae-e281-4f62-aba5-2bbbaf2c732e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:35.414743 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d6f838ae-e281-4f62-aba5-2bbbaf2c732e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:35.415168 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d6f838ae-e281-4f62-aba5-2bbbaf2c732e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:35.445656 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-d6f838ae-e281-4f62-aba5-2bbbaf2c732e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045551 Aug 10 13:42:35.446233 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 336/641] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 10 13:42:35 2022] GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:42:35.471875 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-e7f2c2d9-c39d-4c25-a18a-9224d2b72a4e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:35.472487 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-e7f2c2d9-c39d-4c25-a18a-9224d2b72a4e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:35.478913 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e7f2c2d9-c39d-4c25-a18a-9224d2b72a4e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:35.479404 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e7f2c2d9-c39d-4c25-a18a-9224d2b72a4e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:35.479838 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e7f2c2d9-c39d-4c25-a18a-9224d2b72a4e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:35.480615 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e7f2c2d9-c39d-4c25-a18a-9224d2b72a4e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:35.481064 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e7f2c2d9-c39d-4c25-a18a-9224d2b72a4e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:35.481614 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e7f2c2d9-c39d-4c25-a18a-9224d2b72a4e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:35.614972 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-e7f2c2d9-c39d-4c25-a18a-9224d2b72a4e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:35.622565 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-e7f2c2d9-c39d-4c25-a18a-9224d2b72a4e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1508 microversion: 2.1 time: 0.154471 Aug 10 13:42:35.623136 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 306/642] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:35 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:36.292648 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-ea69d5a9-0676-4d4e-8244-3c40b3d59028 req-0613ad13-68e2-461e-bef4-e01bca5e6570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "783660b7-d622-4df6-85cd-56c623cc835e", "name": "network-vif-deleted", "tag": "10c04e92-bea1-4ea3-9a28-b5ad9e2d1d12"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:42:36.298178 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:42:36.307731 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-ea69d5a9-0676-4d4e-8244-3c40b3d59028 req-0613ad13-68e2-461e-bef4-e01bca5e6570 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:36.308297 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-ea69d5a9-0676-4d4e-8244-3c40b3d59028 req-0613ad13-68e2-461e-bef4-e01bca5e6570 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:36.308922 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-ea69d5a9-0676-4d4e-8244-3c40b3d59028 req-0613ad13-68e2-461e-bef4-e01bca5e6570 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:36.329754 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-ea69d5a9-0676-4d4e-8244-3c40b3d59028 req-0613ad13-68e2-461e-bef4-e01bca5e6570 service nova] Creating event network-vif-deleted:10c04e92-bea1-4ea3-9a28-b5ad9e2d1d12 for instance 783660b7-d622-4df6-85cd-56c623cc835e on hv-cinder-85200 Aug 10 13:42:36.331336 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-ea69d5a9-0676-4d4e-8244-3c40b3d59028 req-0613ad13-68e2-461e-bef4-e01bca5e6570 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042950 Aug 10 13:42:36.332099 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 337/643] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:42:36.458034 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-2eceb2b8-4658-476a-b493-6b4e3d485755 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:36.460211 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-2eceb2b8-4658-476a-b493-6b4e3d485755 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: bfb52e6c-577e-4368-a03e-1be5e40b8e43] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:36.466172 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2eceb2b8-4658-476a-b493-6b4e3d485755 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:36.466652 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2eceb2b8-4658-476a-b493-6b4e3d485755 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:36.467085 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2eceb2b8-4658-476a-b493-6b4e3d485755 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:36.467772 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2eceb2b8-4658-476a-b493-6b4e3d485755 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:36.468734 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2eceb2b8-4658-476a-b493-6b4e3d485755 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:36.469140 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2eceb2b8-4658-476a-b493-6b4e3d485755 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:36.498571 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-2eceb2b8-4658-476a-b493-6b4e3d485755 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044395 Aug 10 13:42:36.499235 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 307/644] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 10 13:42:36 2022] GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 13:42:36.561407 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-6597a52e-f9ba-4916-bc5e-6922c1708265 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:36.562184 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-6597a52e-f9ba-4916-bc5e-6922c1708265 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: bfb52e6c-577e-4368-a03e-1be5e40b8e43] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:36.569642 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6597a52e-f9ba-4916-bc5e-6922c1708265 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:36.570124 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6597a52e-f9ba-4916-bc5e-6922c1708265 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:36.570556 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6597a52e-f9ba-4916-bc5e-6922c1708265 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:36.571245 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6597a52e-f9ba-4916-bc5e-6922c1708265 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:36.571693 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6597a52e-f9ba-4916-bc5e-6922c1708265 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:36.572137 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6597a52e-f9ba-4916-bc5e-6922c1708265 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:36.599178 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-6597a52e-f9ba-4916-bc5e-6922c1708265 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: bfb52e6c-577e-4368-a03e-1be5e40b8e43] Going to try to terminate instance {{(pid=129522) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:42:36.644907 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-4b0c6182-db62-4425-8afd-6aa1dee65f16 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:36.645601 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-4b0c6182-db62-4425-8afd-6aa1dee65f16 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:36.652506 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4b0c6182-db62-4425-8afd-6aa1dee65f16 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:36.652995 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4b0c6182-db62-4425-8afd-6aa1dee65f16 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:36.653737 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4b0c6182-db62-4425-8afd-6aa1dee65f16 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:36.654693 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4b0c6182-db62-4425-8afd-6aa1dee65f16 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:36.655150 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4b0c6182-db62-4425-8afd-6aa1dee65f16 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:36.655719 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4b0c6182-db62-4425-8afd-6aa1dee65f16 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:36.685276 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-6597a52e-f9ba-4916-bc5e-6922c1708265 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43" status: 204 len: 0 microversion: 2.1 time: 0.128384 Aug 10 13:42:36.686162 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 338/645] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 10 13:42:36 2022] DELETE /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:42:36.697057 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-4eefd1fa-c210-4306-a70c-15f56c9958ab tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:36.698515 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-4eefd1fa-c210-4306-a70c-15f56c9958ab tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: bfb52e6c-577e-4368-a03e-1be5e40b8e43] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:36.706392 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4eefd1fa-c210-4306-a70c-15f56c9958ab tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:36.706869 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4eefd1fa-c210-4306-a70c-15f56c9958ab tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:36.707485 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4eefd1fa-c210-4306-a70c-15f56c9958ab tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:36.708275 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4eefd1fa-c210-4306-a70c-15f56c9958ab tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:36.708733 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4eefd1fa-c210-4306-a70c-15f56c9958ab tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:36.709151 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4eefd1fa-c210-4306-a70c-15f56c9958ab tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:36.721442 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4b0c6182-db62-4425-8afd-6aa1dee65f16 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:36.721924 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4b0c6182-db62-4425-8afd-6aa1dee65f16 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:36.722404 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4b0c6182-db62-4425-8afd-6aa1dee65f16 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:36.722850 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.objects.instance [None req-4b0c6182-db62-4425-8afd-6aa1dee65f16 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lazy-loading 'fault' on Instance uuid 783660b7-d622-4df6-85cd-56c623cc835e {{(pid=129523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:42:36.767098 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-4b0c6182-db62-4425-8afd-6aa1dee65f16 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:36.774657 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-4b0c6182-db62-4425-8afd-6aa1dee65f16 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1312 microversion: 2.1 time: 0.134174 Aug 10 13:42:36.775307 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 308/646] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:36 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1312 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:42:36.849870 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-4eefd1fa-c210-4306-a70c-15f56c9958ab tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:36.857393 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-4eefd1fa-c210-4306-a70c-15f56c9958ab tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43" status: 200 len: 1683 microversion: 2.1 time: 0.166428 Aug 10 13:42:36.857961 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 339/647] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:36 2022] GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:42:37.795956 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-e4ef7f0d-a5fa-4857-959d-15fa75fe607e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:37.797167 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-e4ef7f0d-a5fa-4857-959d-15fa75fe607e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:37.803108 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e4ef7f0d-a5fa-4857-959d-15fa75fe607e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:37.803592 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e4ef7f0d-a5fa-4857-959d-15fa75fe607e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:37.804027 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e4ef7f0d-a5fa-4857-959d-15fa75fe607e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:37.804707 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e4ef7f0d-a5fa-4857-959d-15fa75fe607e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:37.805163 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e4ef7f0d-a5fa-4857-959d-15fa75fe607e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:37.805613 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e4ef7f0d-a5fa-4857-959d-15fa75fe607e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:37.835724 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e4ef7f0d-a5fa-4857-959d-15fa75fe607e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:37.836196 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e4ef7f0d-a5fa-4857-959d-15fa75fe607e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:37.836626 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e4ef7f0d-a5fa-4857-959d-15fa75fe607e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:37.837067 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.objects.instance [None req-e4ef7f0d-a5fa-4857-959d-15fa75fe607e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lazy-loading 'fault' on Instance uuid 783660b7-d622-4df6-85cd-56c623cc835e {{(pid=129523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:42:37.878974 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-9bab2005-06e2-471f-ab9d-ef0ab6122c8e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:37.879677 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-9bab2005-06e2-471f-ab9d-ef0ab6122c8e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: bfb52e6c-577e-4368-a03e-1be5e40b8e43] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:37.880311 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-e4ef7f0d-a5fa-4857-959d-15fa75fe607e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:37.886296 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9bab2005-06e2-471f-ab9d-ef0ab6122c8e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:37.886777 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9bab2005-06e2-471f-ab9d-ef0ab6122c8e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:37.887205 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9bab2005-06e2-471f-ab9d-ef0ab6122c8e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:37.887895 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9bab2005-06e2-471f-ab9d-ef0ab6122c8e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:37.888207 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-e4ef7f0d-a5fa-4857-959d-15fa75fe607e tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 200 len: 1312 microversion: 2.1 time: 0.096287 Aug 10 13:42:37.888344 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9bab2005-06e2-471f-ab9d-ef0ab6122c8e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:37.888763 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9bab2005-06e2-471f-ab9d-ef0ab6122c8e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:37.888857 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 309/648] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:37 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:38.019755 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-9bab2005-06e2-471f-ab9d-ef0ab6122c8e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:38.027191 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-9bab2005-06e2-471f-ab9d-ef0ab6122c8e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43" status: 200 len: 1683 microversion: 2.1 time: 0.152534 Aug 10 13:42:38.027785 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 340/649] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:37 2022] GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:42:38.908804 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-bd3b7734-52d4-40af-ada6-3c4c91991e9d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:38.909439 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-bd3b7734-52d4-40af-ada6-3c4c91991e9d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 783660b7-d622-4df6-85cd-56c623cc835e] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:38.915824 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bd3b7734-52d4-40af-ada6-3c4c91991e9d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:38.916304 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bd3b7734-52d4-40af-ada6-3c4c91991e9d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:38.916731 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bd3b7734-52d4-40af-ada6-3c4c91991e9d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:38.917442 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bd3b7734-52d4-40af-ada6-3c4c91991e9d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:38.917890 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bd3b7734-52d4-40af-ada6-3c4c91991e9d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:38.918306 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bd3b7734-52d4-40af-ada6-3c4c91991e9d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:38.933214 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.wsgi [None req-bd3b7734-52d4-40af-ada6-3c4c91991e9d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] HTTP exception thrown: Instance 783660b7-d622-4df6-85cd-56c623cc835e could not be found. Aug 10 13:42:38.934834 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-bd3b7734-52d4-40af-ada6-3c4c91991e9d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Request method failure captured: Aug 10 13:42:38.934834 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: request: GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e HTTP/1.1 Aug 10 13:42:38.934834 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept: application/json Aug 10 13:42:38.934834 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept-Encoding: identity Aug 10 13:42:38.934834 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Connection: close Aug 10 13:42:38.934834 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Length: 0 Aug 10 13:42:38.934834 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Type: application/json Aug 10 13:42:38.934834 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Host: 10.222.0.52 Aug 10 13:42:38.934834 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Openstack-System-Scope: None Aug 10 13:42:38.934834 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: User-Agent: python-urllib3/1.26.11 Aug 10 13:42:38.934834 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Auth-Token: gAAAAABi87SyiKkY4w5thpU-lMeFOv-pupV3M4p5O_G9Bq0nw7Mt72anXX_8NpPA6bSBk3F77efaTtx9_wfsx9tfpnDHinM6_nwESAvKYqiVuXh6I6GeGsfaWe_Ya10ueo8dBFFLc_3EiOnm1SU3tp8oyoyNzcvZhdKgk0BRE0yUrE4ibPeYstg Aug 10 13:42:38.934834 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Id: None Aug 10 13:42:38.934834 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Name: None Aug 10 13:42:38.934834 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Identity-Status: Confirmed Aug 10 13:42:38.934834 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Is-Admin-Project: True Aug 10 13:42:38.934834 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Id: default Aug 10 13:42:38.934834 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Name: Default Aug 10 13:42:38.934834 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Id: d8eda7c7d6a348e08e81a6b2496b09e5 Aug 10 13:42:38.934834 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2121919159 Aug 10 13:42:38.934834 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Role: member,reader Aug 10 13:42:38.934834 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Roles: member,reader Aug 10 13:42:38.936225 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d8eda7c7d6a348e08e81a6b2496b09e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d8eda7c7d6a348e08e81a6b2496b09e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d8eda7c7d6a348e08e81a6b2496b09e5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d8eda7c7d6a348e08e81a6b2496b09e5"}]}] Aug 10 13:42:38.936225 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2121919159 Aug 10 13:42:38.936225 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Id: d8eda7c7d6a348e08e81a6b2496b09e5 Aug 10 13:42:38.936225 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2121919159 Aug 10 13:42:38.936225 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User: tempest-ServerRescueNegativeTestJSON-2121919159-project Aug 10 13:42:38.936225 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Id: default Aug 10 13:42:38.936225 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Name: Default Aug 10 13:42:38.936225 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Id: 5573338f0bd64c729c7d89345069ca6f Aug 10 13:42:38.936225 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2121919159-project Aug 10 13:42:38.936225 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: method: > Aug 10 13:42:38.936225 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: exception: Instance 783660b7-d622-4df6-85cd-56c623cc835e could not be found. Aug 10 13:42:38.936225 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: action_args: {'id': '783660b7-d622-4df6-85cd-56c623cc835e'} Aug 10 13:42:38.937091 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:42:38.937091 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:42:38.937091 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:42:38.937091 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:42:38.937091 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:42:38.937091 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:42:38.937091 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:42:38.937091 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:42:38.937091 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:42:38.937091 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:42:38.937091 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 783660b7-d622-4df6-85cd-56c623cc835e could not be found. Aug 10 13:42:38.937091 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:42:38.937091 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:42:38.937091 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:42:38.937091 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:42:38.937091 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:42:38.937091 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:42:38.937091 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:42:38.937091 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:42:38.937091 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:42:38.939460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:42:38.939460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:42:38.939460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:42:38.939460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:42:38.939460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:42:38.939460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:42:38.939460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:42:38.939460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 783660b7-d622-4df6-85cd-56c623cc835e could not be found. Aug 10 13:42:38.939460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:42:38.939460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:42:38.939460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:42:38.939460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:42:38.939460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:42:38.939460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:42:38.939460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:42:38.939460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:42:38.939460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 783660b7-d622-4df6-85cd-56c623cc835e could not be found. Aug 10 13:42:38.939460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:42:38.941530 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-bd3b7734-52d4-40af-ada6-3c4c91991e9d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Returning 404 to user: Instance 783660b7-d622-4df6-85cd-56c623cc835e could not be found. {{(pid=129523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:42:38.941530 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-bd3b7734-52d4-40af-ada6-3c4c91991e9d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e" status: 404 len: 111 microversion: 2.1 time: 0.031655 Aug 10 13:42:38.941530 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 310/650] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:38 2022] GET /compute/v2.1/servers/783660b7-d622-4df6-85cd-56c623cc835e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:42:38.947107 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-2e552028-a45f-4c60-8937-c392825c5a67 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:38.947671 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-2e552028-a45f-4c60-8937-c392825c5a67 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 9107fc16-6a2c-48ad-8612-964c3ac05c01] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:38.954242 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2e552028-a45f-4c60-8937-c392825c5a67 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:38.954726 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2e552028-a45f-4c60-8937-c392825c5a67 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:38.955168 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2e552028-a45f-4c60-8937-c392825c5a67 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:38.955861 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2e552028-a45f-4c60-8937-c392825c5a67 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:38.956318 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2e552028-a45f-4c60-8937-c392825c5a67 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:38.956971 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2e552028-a45f-4c60-8937-c392825c5a67 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:38.983720 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-2e552028-a45f-4c60-8937-c392825c5a67 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 9107fc16-6a2c-48ad-8612-964c3ac05c01] Going to try to terminate instance {{(pid=129522) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:42:39.050765 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-94002d12-a147-47da-a529-9468da7d46c8 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:39.051390 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-94002d12-a147-47da-a529-9468da7d46c8 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: bfb52e6c-577e-4368-a03e-1be5e40b8e43] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:39.068860 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-94002d12-a147-47da-a529-9468da7d46c8 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:39.069468 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-2e552028-a45f-4c60-8937-c392825c5a67 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01" status: 204 len: 0 microversion: 2.1 time: 0.126932 Aug 10 13:42:39.069996 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-94002d12-a147-47da-a529-9468da7d46c8 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:39.072577 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-94002d12-a147-47da-a529-9468da7d46c8 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:39.073407 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 341/651] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 10 13:42:38 2022] DELETE /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:42:39.077418 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-94002d12-a147-47da-a529-9468da7d46c8 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:39.078606 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-94002d12-a147-47da-a529-9468da7d46c8 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:39.078788 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-bd9b28f1-fdeb-4bc0-af05-930cd9f5ed24 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:39.079310 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-94002d12-a147-47da-a529-9468da7d46c8 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:39.079858 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-bd9b28f1-fdeb-4bc0-af05-930cd9f5ed24 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 9107fc16-6a2c-48ad-8612-964c3ac05c01] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:39.085893 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-bd9b28f1-fdeb-4bc0-af05-930cd9f5ed24 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:39.086371 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-bd9b28f1-fdeb-4bc0-af05-930cd9f5ed24 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:39.086805 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-bd9b28f1-fdeb-4bc0-af05-930cd9f5ed24 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:39.087669 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-bd9b28f1-fdeb-4bc0-af05-930cd9f5ed24 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:39.088128 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-bd9b28f1-fdeb-4bc0-af05-930cd9f5ed24 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:39.088551 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-bd9b28f1-fdeb-4bc0-af05-930cd9f5ed24 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:39.242743 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-bd9b28f1-fdeb-4bc0-af05-930cd9f5ed24 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:39.251716 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-bd9b28f1-fdeb-4bc0-af05-930cd9f5ed24 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01" status: 200 len: 1520 microversion: 2.1 time: 0.177001 Aug 10 13:42:39.252309 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 342/652] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:39 2022] GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:39.400413 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-94002d12-a147-47da-a529-9468da7d46c8 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:39.408545 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-94002d12-a147-47da-a529-9468da7d46c8 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43" status: 200 len: 1616 microversion: 2.1 time: 0.362896 Aug 10 13:42:39.410278 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 311/653] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:39 2022] GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43 => generated 1616 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:42:39.588983 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-af2ba818-4f35-40bf-8b76-8d95a85c2722 req-4dc241c4-8f9f-4204-84b0-b59467a46af6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfb52e6c-577e-4368-a03e-1be5e40b8e43", "name": "network-vif-deleted", "tag": "f7c32ace-7a87-4f81-b64d-8dcc4f7bf65d"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:42:39.598466 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-af2ba818-4f35-40bf-8b76-8d95a85c2722 req-4dc241c4-8f9f-4204-84b0-b59467a46af6 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:39.599038 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-af2ba818-4f35-40bf-8b76-8d95a85c2722 req-4dc241c4-8f9f-4204-84b0-b59467a46af6 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:39.599525 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-af2ba818-4f35-40bf-8b76-8d95a85c2722 req-4dc241c4-8f9f-4204-84b0-b59467a46af6 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:39.611503 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-af2ba818-4f35-40bf-8b76-8d95a85c2722 req-4dc241c4-8f9f-4204-84b0-b59467a46af6 service nova] Creating event network-vif-deleted:f7c32ace-7a87-4f81-b64d-8dcc4f7bf65d for instance bfb52e6c-577e-4368-a03e-1be5e40b8e43 on hv-cinder-85200 Aug 10 13:42:39.617071 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-af2ba818-4f35-40bf-8b76-8d95a85c2722 req-4dc241c4-8f9f-4204-84b0-b59467a46af6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032010 Aug 10 13:42:39.617934 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 343/654] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:42:40.102406 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-cec6d9a0-e0cf-4245-b434-2773410207b0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:40.104678 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-cec6d9a0-e0cf-4245-b434-2773410207b0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:40.111383 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cec6d9a0-e0cf-4245-b434-2773410207b0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:40.111815 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cec6d9a0-e0cf-4245-b434-2773410207b0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:40.112243 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cec6d9a0-e0cf-4245-b434-2773410207b0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:40.120660 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cec6d9a0-e0cf-4245-b434-2773410207b0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:40.120660 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cec6d9a0-e0cf-4245-b434-2773410207b0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:40.120660 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cec6d9a0-e0cf-4245-b434-2773410207b0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:40.144692 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-cec6d9a0-e0cf-4245-b434-2773410207b0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046207 Aug 10 13:42:40.145606 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 312/655] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 10 13:42:40 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 13:42:40.210974 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-2abb605f-dcd8-4aed-9a08-d075b03f14cd tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:40.211583 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-2abb605f-dcd8-4aed-9a08-d075b03f14cd tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:40.218086 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2abb605f-dcd8-4aed-9a08-d075b03f14cd tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:40.218612 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2abb605f-dcd8-4aed-9a08-d075b03f14cd tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:40.219067 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2abb605f-dcd8-4aed-9a08-d075b03f14cd tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:40.219759 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2abb605f-dcd8-4aed-9a08-d075b03f14cd tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:40.220217 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2abb605f-dcd8-4aed-9a08-d075b03f14cd tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:40.220646 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2abb605f-dcd8-4aed-9a08-d075b03f14cd tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:40.247258 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-2abb605f-dcd8-4aed-9a08-d075b03f14cd tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Going to try to terminate instance {{(pid=129522) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:42:40.276018 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-545d5632-6b1e-4a8e-a8fa-496747f58cb7 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:40.276912 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-545d5632-6b1e-4a8e-a8fa-496747f58cb7 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 9107fc16-6a2c-48ad-8612-964c3ac05c01] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:40.284642 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-545d5632-6b1e-4a8e-a8fa-496747f58cb7 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:40.285562 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-545d5632-6b1e-4a8e-a8fa-496747f58cb7 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:40.286138 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-545d5632-6b1e-4a8e-a8fa-496747f58cb7 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:40.287188 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-545d5632-6b1e-4a8e-a8fa-496747f58cb7 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:40.287930 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-545d5632-6b1e-4a8e-a8fa-496747f58cb7 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:40.288619 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-545d5632-6b1e-4a8e-a8fa-496747f58cb7 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:40.333353 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-2abb605f-dcd8-4aed-9a08-d075b03f14cd tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "DELETE /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 204 len: 0 microversion: 2.1 time: 0.126445 Aug 10 13:42:40.334094 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 344/656] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 10 13:42:40 2022] DELETE /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:42:40.344051 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-dec6cfbc-ee7d-48cd-8882-7d4c66822b61 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:40.345136 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-dec6cfbc-ee7d-48cd-8882-7d4c66822b61 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:40.352730 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-dec6cfbc-ee7d-48cd-8882-7d4c66822b61 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:40.353466 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-dec6cfbc-ee7d-48cd-8882-7d4c66822b61 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:40.354391 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-dec6cfbc-ee7d-48cd-8882-7d4c66822b61 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:40.355380 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-dec6cfbc-ee7d-48cd-8882-7d4c66822b61 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:40.355944 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-dec6cfbc-ee7d-48cd-8882-7d4c66822b61 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:40.356474 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-dec6cfbc-ee7d-48cd-8882-7d4c66822b61 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:40.434764 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-545d5632-6b1e-4a8e-a8fa-496747f58cb7 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:40.444085 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-545d5632-6b1e-4a8e-a8fa-496747f58cb7 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01" status: 200 len: 1520 microversion: 2.1 time: 0.173443 Aug 10 13:42:40.444748 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 313/657] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:40 2022] GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:42:40.449560 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-a08b823e-ddfc-4f2c-b1be-44c6212e3949 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:40.450257 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-a08b823e-ddfc-4f2c-b1be-44c6212e3949 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: bfb52e6c-577e-4368-a03e-1be5e40b8e43] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:40.456828 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a08b823e-ddfc-4f2c-b1be-44c6212e3949 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:40.457531 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a08b823e-ddfc-4f2c-b1be-44c6212e3949 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:40.458067 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a08b823e-ddfc-4f2c-b1be-44c6212e3949 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:40.458834 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a08b823e-ddfc-4f2c-b1be-44c6212e3949 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:40.459379 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a08b823e-ddfc-4f2c-b1be-44c6212e3949 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:40.459948 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a08b823e-ddfc-4f2c-b1be-44c6212e3949 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:40.501545 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-dec6cfbc-ee7d-48cd-8882-7d4c66822b61 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:40.512058 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-dec6cfbc-ee7d-48cd-8882-7d4c66822b61 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1670 microversion: 2.1 time: 0.173355 Aug 10 13:42:40.513268 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 345/658] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:40 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1670 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:42:40.527170 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-a08b823e-ddfc-4f2c-b1be-44c6212e3949 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:40.535716 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-a08b823e-ddfc-4f2c-b1be-44c6212e3949 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43" status: 200 len: 1616 microversion: 2.1 time: 0.089709 Aug 10 13:42:40.536291 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 314/659] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:40 2022] GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43 => generated 1616 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:41.465722 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-92127138-bf46-4918-92d2-1914f9fe9d54 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:41.466322 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-92127138-bf46-4918-92d2-1914f9fe9d54 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 9107fc16-6a2c-48ad-8612-964c3ac05c01] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:41.472865 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-92127138-bf46-4918-92d2-1914f9fe9d54 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:41.473384 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-92127138-bf46-4918-92d2-1914f9fe9d54 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:41.473814 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-92127138-bf46-4918-92d2-1914f9fe9d54 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:41.474496 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-92127138-bf46-4918-92d2-1914f9fe9d54 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:41.474943 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-92127138-bf46-4918-92d2-1914f9fe9d54 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:41.475356 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-92127138-bf46-4918-92d2-1914f9fe9d54 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:41.533032 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-b426f4ad-8e86-4c7a-8eee-f2aff70aa021 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:41.533607 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-b426f4ad-8e86-4c7a-8eee-f2aff70aa021 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:41.540118 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b426f4ad-8e86-4c7a-8eee-f2aff70aa021 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:41.540611 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b426f4ad-8e86-4c7a-8eee-f2aff70aa021 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:41.541047 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b426f4ad-8e86-4c7a-8eee-f2aff70aa021 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:41.541785 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b426f4ad-8e86-4c7a-8eee-f2aff70aa021 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:41.542239 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b426f4ad-8e86-4c7a-8eee-f2aff70aa021 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:41.542658 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b426f4ad-8e86-4c7a-8eee-f2aff70aa021 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:41.680355 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-b426f4ad-8e86-4c7a-8eee-f2aff70aa021 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:41.688903 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-b426f4ad-8e86-4c7a-8eee-f2aff70aa021 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1670 microversion: 2.1 time: 0.159789 Aug 10 13:42:41.689523 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 315/660] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:41 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1670 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:42:41.707033 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-da9f0c8f-a3a4-4769-97c1-97824cb32e0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:41.707789 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-da9f0c8f-a3a4-4769-97c1-97824cb32e0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: bfb52e6c-577e-4368-a03e-1be5e40b8e43] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:41.714183 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-da9f0c8f-a3a4-4769-97c1-97824cb32e0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:41.714755 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-da9f0c8f-a3a4-4769-97c1-97824cb32e0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:41.715253 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-da9f0c8f-a3a4-4769-97c1-97824cb32e0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:41.716017 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-da9f0c8f-a3a4-4769-97c1-97824cb32e0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:41.719750 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-da9f0c8f-a3a4-4769-97c1-97824cb32e0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:41.719750 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-da9f0c8f-a3a4-4769-97c1-97824cb32e0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:41.784485 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-da9f0c8f-a3a4-4769-97c1-97824cb32e0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:41.792384 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-da9f0c8f-a3a4-4769-97c1-97824cb32e0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43" status: 200 len: 1616 microversion: 2.1 time: 0.089798 Aug 10 13:42:41.793068 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 316/661] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:41 2022] GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43 => generated 1616 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:41.840353 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-92127138-bf46-4918-92d2-1914f9fe9d54 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:41.847922 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-92127138-bf46-4918-92d2-1914f9fe9d54 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01" status: 200 len: 1520 microversion: 2.1 time: 0.386015 Aug 10 13:42:41.848508 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 346/662] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:41 2022] GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01 => generated 1520 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:42.711467 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-e849a81e-16b4-4513-9439-eeb2213979de tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:42.712006 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-e849a81e-16b4-4513-9439-eeb2213979de tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:42.718836 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e849a81e-16b4-4513-9439-eeb2213979de tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:42.719753 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e849a81e-16b4-4513-9439-eeb2213979de tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:42.720193 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e849a81e-16b4-4513-9439-eeb2213979de tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:42.720886 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e849a81e-16b4-4513-9439-eeb2213979de tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:42.721375 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e849a81e-16b4-4513-9439-eeb2213979de tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:42.721800 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e849a81e-16b4-4513-9439-eeb2213979de tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:42.814792 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-1ac053f7-b18b-4d1e-9674-97dd1001afa2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:42.815400 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-1ac053f7-b18b-4d1e-9674-97dd1001afa2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: bfb52e6c-577e-4368-a03e-1be5e40b8e43] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:42.822007 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1ac053f7-b18b-4d1e-9674-97dd1001afa2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:42.822491 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1ac053f7-b18b-4d1e-9674-97dd1001afa2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:42.822920 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1ac053f7-b18b-4d1e-9674-97dd1001afa2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:42.823614 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1ac053f7-b18b-4d1e-9674-97dd1001afa2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:42.824064 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1ac053f7-b18b-4d1e-9674-97dd1001afa2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:42.824484 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1ac053f7-b18b-4d1e-9674-97dd1001afa2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:42.857898 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-e849a81e-16b4-4513-9439-eeb2213979de tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:42.866558 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-e849a81e-16b4-4513-9439-eeb2213979de tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1670 microversion: 2.1 time: 0.159073 Aug 10 13:42:42.867128 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 317/663] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:42 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1670 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:42.871557 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-b58dfff7-3225-4326-ba38-6d7f4feb56f5 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:42.872182 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-b58dfff7-3225-4326-ba38-6d7f4feb56f5 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 9107fc16-6a2c-48ad-8612-964c3ac05c01] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:42.878231 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b58dfff7-3225-4326-ba38-6d7f4feb56f5 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:42.878716 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b58dfff7-3225-4326-ba38-6d7f4feb56f5 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:42.879380 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b58dfff7-3225-4326-ba38-6d7f4feb56f5 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:42.880075 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b58dfff7-3225-4326-ba38-6d7f4feb56f5 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:42.880521 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b58dfff7-3225-4326-ba38-6d7f4feb56f5 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:42.880940 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b58dfff7-3225-4326-ba38-6d7f4feb56f5 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:42.888803 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-1ac053f7-b18b-4d1e-9674-97dd1001afa2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:42.891218 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=93,nova_cell1:UPDATE=3 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:42:42.897834 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-1ac053f7-b18b-4d1e-9674-97dd1001afa2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43" status: 200 len: 1327 microversion: 2.1 time: 0.087425 Aug 10 13:42:42.898411 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 347/664] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:42 2022] GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43 => generated 1327 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:42:43.014150 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-b58dfff7-3225-4326-ba38-6d7f4feb56f5 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:43.021585 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-b58dfff7-3225-4326-ba38-6d7f4feb56f5 tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01" status: 200 len: 1520 microversion: 2.1 time: 0.153493 Aug 10 13:42:43.022143 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 318/665] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:42 2022] GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:43.888737 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-9e20dc68-7b70-46f0-b27b-8c1cb11b8387 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:43.889406 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-9e20dc68-7b70-46f0-b27b-8c1cb11b8387 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:43.897502 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9e20dc68-7b70-46f0-b27b-8c1cb11b8387 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:43.897988 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9e20dc68-7b70-46f0-b27b-8c1cb11b8387 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:43.898417 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9e20dc68-7b70-46f0-b27b-8c1cb11b8387 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:43.899096 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9e20dc68-7b70-46f0-b27b-8c1cb11b8387 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:43.899546 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9e20dc68-7b70-46f0-b27b-8c1cb11b8387 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:43.899960 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9e20dc68-7b70-46f0-b27b-8c1cb11b8387 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:43.919053 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-6e469287-db39-4f96-a21b-360ed511429e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:43.919655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-6e469287-db39-4f96-a21b-360ed511429e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: bfb52e6c-577e-4368-a03e-1be5e40b8e43] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:43.926078 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6e469287-db39-4f96-a21b-360ed511429e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:43.926590 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6e469287-db39-4f96-a21b-360ed511429e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:43.927019 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6e469287-db39-4f96-a21b-360ed511429e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:43.927708 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6e469287-db39-4f96-a21b-360ed511429e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:43.928196 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6e469287-db39-4f96-a21b-360ed511429e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:43.930370 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6e469287-db39-4f96-a21b-360ed511429e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:44.004453 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-6e469287-db39-4f96-a21b-360ed511429e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:44.012219 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-6e469287-db39-4f96-a21b-360ed511429e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43" status: 200 len: 1327 microversion: 2.1 time: 0.096931 Aug 10 13:42:44.012802 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 319/666] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:43 2022] GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43 => generated 1327 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:42:44.033728 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-9e20dc68-7b70-46f0-b27b-8c1cb11b8387 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:44.041376 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-9e20dc68-7b70-46f0-b27b-8c1cb11b8387 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1670 microversion: 2.1 time: 0.156582 Aug 10 13:42:44.041944 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 348/667] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:43 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1670 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:44.043406 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-60247d15-3289-4f4e-ad1c-95273fbbf71f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:44.044053 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-60247d15-3289-4f4e-ad1c-95273fbbf71f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 9107fc16-6a2c-48ad-8612-964c3ac05c01] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:44.050953 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-60247d15-3289-4f4e-ad1c-95273fbbf71f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:44.051445 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-60247d15-3289-4f4e-ad1c-95273fbbf71f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:44.051917 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-60247d15-3289-4f4e-ad1c-95273fbbf71f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:44.052591 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-60247d15-3289-4f4e-ad1c-95273fbbf71f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:44.053056 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-60247d15-3289-4f4e-ad1c-95273fbbf71f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:44.053571 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-60247d15-3289-4f4e-ad1c-95273fbbf71f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:44.184049 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-60247d15-3289-4f4e-ad1c-95273fbbf71f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:44.188169 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell1:SELECT=100 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:42:44.193558 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-60247d15-3289-4f4e-ad1c-95273fbbf71f tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01" status: 200 len: 1520 microversion: 2.1 time: 0.154043 Aug 10 13:42:44.194146 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 320/668] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:44 2022] GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:42:45.034413 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-4cec1a3e-c835-4bd5-a577-375635a609ef tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:45.035025 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-4cec1a3e-c835-4bd5-a577-375635a609ef tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: bfb52e6c-577e-4368-a03e-1be5e40b8e43] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:45.042280 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4cec1a3e-c835-4bd5-a577-375635a609ef tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:45.042763 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4cec1a3e-c835-4bd5-a577-375635a609ef tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:45.043188 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4cec1a3e-c835-4bd5-a577-375635a609ef tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:45.043873 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4cec1a3e-c835-4bd5-a577-375635a609ef tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:45.044321 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4cec1a3e-c835-4bd5-a577-375635a609ef tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:45.044735 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4cec1a3e-c835-4bd5-a577-375635a609ef tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:45.063656 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-c74722e2-66ba-4e93-a1e1-992bb16b36f8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:45.064943 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-c74722e2-66ba-4e93-a1e1-992bb16b36f8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:45.072253 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c74722e2-66ba-4e93-a1e1-992bb16b36f8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:45.072738 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c74722e2-66ba-4e93-a1e1-992bb16b36f8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:45.073408 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c74722e2-66ba-4e93-a1e1-992bb16b36f8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:45.074112 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c74722e2-66ba-4e93-a1e1-992bb16b36f8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:45.074565 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c74722e2-66ba-4e93-a1e1-992bb16b36f8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:45.074990 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c74722e2-66ba-4e93-a1e1-992bb16b36f8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:45.078244 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4cec1a3e-c835-4bd5-a577-375635a609ef tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:45.078724 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4cec1a3e-c835-4bd5-a577-375635a609ef tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:45.079155 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4cec1a3e-c835-4bd5-a577-375635a609ef tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:45.079588 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.objects.instance [None req-4cec1a3e-c835-4bd5-a577-375635a609ef tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lazy-loading 'fault' on Instance uuid bfb52e6c-577e-4368-a03e-1be5e40b8e43 {{(pid=129522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:42:45.132301 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-4cec1a3e-c835-4bd5-a577-375635a609ef tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:45.140395 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-4cec1a3e-c835-4bd5-a577-375635a609ef tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43" status: 200 len: 1332 microversion: 2.1 time: 0.110536 Aug 10 13:42:45.140990 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 349/669] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:45 2022] GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43 => generated 1332 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:45.146575 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-1ba8c997-68bb-44e3-8adf-1ab454006a6f req-836ab81f-3fc7-4f55-a007-552a77b0f5df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9107fc16-6a2c-48ad-8612-964c3ac05c01", "name": "network-vif-deleted", "tag": "ce8bc99b-8473-443a-affd-c91a70f09259"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:42:45.156499 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-1ba8c997-68bb-44e3-8adf-1ab454006a6f req-836ab81f-3fc7-4f55-a007-552a77b0f5df service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:45.156929 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-1ba8c997-68bb-44e3-8adf-1ab454006a6f req-836ab81f-3fc7-4f55-a007-552a77b0f5df service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:45.157388 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-1ba8c997-68bb-44e3-8adf-1ab454006a6f req-836ab81f-3fc7-4f55-a007-552a77b0f5df service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:45.168125 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-1ba8c997-68bb-44e3-8adf-1ab454006a6f req-836ab81f-3fc7-4f55-a007-552a77b0f5df service nova] Creating event network-vif-deleted:ce8bc99b-8473-443a-affd-c91a70f09259 for instance 9107fc16-6a2c-48ad-8612-964c3ac05c01 on hv-cinder-85200 Aug 10 13:42:45.173674 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-1ba8c997-68bb-44e3-8adf-1ab454006a6f req-836ab81f-3fc7-4f55-a007-552a77b0f5df service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031474 Aug 10 13:42:45.174514 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 350/670] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:42:45.217070 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-b5c03d5f-b0a9-4a4a-87bd-e4715c1f5f0d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:45.218755 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-b5c03d5f-b0a9-4a4a-87bd-e4715c1f5f0d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 9107fc16-6a2c-48ad-8612-964c3ac05c01] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:45.226126 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b5c03d5f-b0a9-4a4a-87bd-e4715c1f5f0d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:45.226983 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b5c03d5f-b0a9-4a4a-87bd-e4715c1f5f0d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:45.227904 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b5c03d5f-b0a9-4a4a-87bd-e4715c1f5f0d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:45.228961 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b5c03d5f-b0a9-4a4a-87bd-e4715c1f5f0d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:45.229094 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-c74722e2-66ba-4e93-a1e1-992bb16b36f8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:45.229897 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b5c03d5f-b0a9-4a4a-87bd-e4715c1f5f0d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:45.230603 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b5c03d5f-b0a9-4a4a-87bd-e4715c1f5f0d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:45.246341 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-c74722e2-66ba-4e93-a1e1-992bb16b36f8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1670 microversion: 2.1 time: 0.186532 Aug 10 13:42:45.246936 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 321/671] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:45 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1670 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:42:45.347851 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-b5c03d5f-b0a9-4a4a-87bd-e4715c1f5f0d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5573338f0bd64c729c7d89345069ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8eda7c7d6a348e08e81a6b2496b09e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:45.359796 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-b5c03d5f-b0a9-4a4a-87bd-e4715c1f5f0d tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01" status: 200 len: 1305 microversion: 2.1 time: 0.146069 Aug 10 13:42:45.368400 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 351/672] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:45 2022] GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01 => generated 1305 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:46.080660 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-e7cb1c34-d19e-4217-ac3c-f9017afa7d2f req-7e0a4094-bcc7-4d41-855c-b103cd5781a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "589498ff-2901-49e5-91c2-0275f4dcf522", "name": "network-vif-deleted", "tag": "55a42d5a-6bbe-4f41-9140-ed498c4f571f"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:42:46.095935 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-e7cb1c34-d19e-4217-ac3c-f9017afa7d2f req-7e0a4094-bcc7-4d41-855c-b103cd5781a9 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:46.096405 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-e7cb1c34-d19e-4217-ac3c-f9017afa7d2f req-7e0a4094-bcc7-4d41-855c-b103cd5781a9 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:46.097068 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-e7cb1c34-d19e-4217-ac3c-f9017afa7d2f req-7e0a4094-bcc7-4d41-855c-b103cd5781a9 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:46.117545 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-e7cb1c34-d19e-4217-ac3c-f9017afa7d2f req-7e0a4094-bcc7-4d41-855c-b103cd5781a9 service nova] Creating event network-vif-deleted:55a42d5a-6bbe-4f41-9140-ed498c4f571f for instance 589498ff-2901-49e5-91c2-0275f4dcf522 on hv-cinder-85200 Aug 10 13:42:46.122724 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-e7cb1c34-d19e-4217-ac3c-f9017afa7d2f req-7e0a4094-bcc7-4d41-855c-b103cd5781a9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045699 Aug 10 13:42:46.123301 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 322/673] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:42:46.230957 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-860a9702-96c2-4870-8593-18b56269c5d5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:46.231632 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-860a9702-96c2-4870-8593-18b56269c5d5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: bfb52e6c-577e-4368-a03e-1be5e40b8e43] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:46.241783 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-860a9702-96c2-4870-8593-18b56269c5d5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:46.242782 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-860a9702-96c2-4870-8593-18b56269c5d5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:46.243441 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-860a9702-96c2-4870-8593-18b56269c5d5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:46.244383 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-860a9702-96c2-4870-8593-18b56269c5d5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:46.245059 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-860a9702-96c2-4870-8593-18b56269c5d5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:46.245727 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-860a9702-96c2-4870-8593-18b56269c5d5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:46.265031 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.wsgi [None req-860a9702-96c2-4870-8593-18b56269c5d5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] HTTP exception thrown: Instance bfb52e6c-577e-4368-a03e-1be5e40b8e43 could not be found. Aug 10 13:42:46.267191 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-860a9702-96c2-4870-8593-18b56269c5d5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Request method failure captured: Aug 10 13:42:46.267191 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: request: GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43 HTTP/1.1 Aug 10 13:42:46.267191 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept: application/json Aug 10 13:42:46.267191 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept-Encoding: identity Aug 10 13:42:46.267191 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Connection: close Aug 10 13:42:46.267191 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Length: 0 Aug 10 13:42:46.267191 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Type: application/json Aug 10 13:42:46.267191 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Host: 10.222.0.52 Aug 10 13:42:46.267191 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Openstack-System-Scope: None Aug 10 13:42:46.267191 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: User-Agent: python-urllib3/1.26.11 Aug 10 13:42:46.267191 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Auth-Token: gAAAAABi87Sor1QukN8WwkCMRH0utTzHqdtW9hBypcULvW8_thEN8NIRbRb3dRFY62pVCieUmq7t4p3U1aqc6NH3mLhkTq5eSrbHxF5HfdCRrvoVeQ0o3DpawgBQQZEUeD2RccyRTg2LrZLPb9H0A6tO9wPr-HvRM84fUPq4D0GzK22Ap72p14g Aug 10 13:42:46.267191 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Id: None Aug 10 13:42:46.267191 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Name: None Aug 10 13:42:46.267191 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Identity-Status: Confirmed Aug 10 13:42:46.267191 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Is-Admin-Project: True Aug 10 13:42:46.267191 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Id: default Aug 10 13:42:46.267191 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Name: Default Aug 10 13:42:46.267191 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Id: 48e5556cbbfd4b00aa4f6055cd6238b2 Aug 10 13:42:46.267191 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Name: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:42:46.267191 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Role: member,reader Aug 10 13:42:46.267191 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Roles: member,reader Aug 10 13:42:46.268459 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/48e5556cbbfd4b00aa4f6055cd6238b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48e5556cbbfd4b00aa4f6055cd6238b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_48e5556cbbfd4b00aa4f6055cd6238b2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48e5556cbbfd4b00aa4f6055cd6238b2"}]}] Aug 10 13:42:46.268459 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:42:46.268459 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Id: 48e5556cbbfd4b00aa4f6055cd6238b2 Aug 10 13:42:46.268459 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:42:46.268459 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User: tempest-AttachVolumeNegativeTest-965925392-project Aug 10 13:42:46.268459 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Id: default Aug 10 13:42:46.268459 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Name: Default Aug 10 13:42:46.268459 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Id: a3d9e5dc719c430eac6b5c8d8b814566 Aug 10 13:42:46.268459 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Name: tempest-AttachVolumeNegativeTest-965925392-project Aug 10 13:42:46.268459 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: method: > Aug 10 13:42:46.268459 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: exception: Instance bfb52e6c-577e-4368-a03e-1be5e40b8e43 could not be found. Aug 10 13:42:46.268459 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: action_args: {'id': 'bfb52e6c-577e-4368-a03e-1be5e40b8e43'} Aug 10 13:42:46.269194 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:42:46.269194 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:42:46.269194 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:42:46.269194 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:42:46.269194 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:42:46.269194 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:42:46.269194 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:42:46.269194 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:42:46.269194 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:42:46.269194 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:42:46.269194 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfb52e6c-577e-4368-a03e-1be5e40b8e43 could not be found. Aug 10 13:42:46.269194 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:42:46.269194 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:42:46.269194 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:42:46.269194 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:42:46.269194 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:42:46.269194 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:42:46.269194 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:42:46.269194 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:42:46.269194 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:42:46.270411 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:42:46.270411 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:42:46.270411 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:42:46.270411 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:42:46.270411 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:42:46.270411 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:42:46.270411 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:42:46.270411 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfb52e6c-577e-4368-a03e-1be5e40b8e43 could not be found. Aug 10 13:42:46.270411 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:42:46.270411 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:42:46.270411 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:42:46.270411 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:42:46.270411 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:42:46.270411 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:42:46.270411 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:42:46.270411 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:42:46.270411 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfb52e6c-577e-4368-a03e-1be5e40b8e43 could not be found. Aug 10 13:42:46.270411 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:42:46.271494 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-ea2a879c-c99b-4f08-bf7b-3b04d56b18bc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:46.271494 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-ea2a879c-c99b-4f08-bf7b-3b04d56b18bc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:46.273544 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-860a9702-96c2-4870-8593-18b56269c5d5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Returning 404 to user: Instance bfb52e6c-577e-4368-a03e-1be5e40b8e43 could not be found. {{(pid=129522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:42:46.274663 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-860a9702-96c2-4870-8593-18b56269c5d5 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43" status: 404 len: 111 microversion: 2.1 time: 0.117280 Aug 10 13:42:46.275799 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 352/674] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:46 2022] GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:42:46.283837 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ea2a879c-c99b-4f08-bf7b-3b04d56b18bc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:46.283837 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ea2a879c-c99b-4f08-bf7b-3b04d56b18bc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:46.284335 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ea2a879c-c99b-4f08-bf7b-3b04d56b18bc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:46.285098 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ea2a879c-c99b-4f08-bf7b-3b04d56b18bc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:46.285596 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ea2a879c-c99b-4f08-bf7b-3b04d56b18bc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:46.286015 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ea2a879c-c99b-4f08-bf7b-3b04d56b18bc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:46.286542 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-0e587d83-f898-4141-896b-d11e8eb08094 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '.version_select at 0x7f49c450c700>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:46.315448 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-0e587d83-f898-4141-896b-d11e8eb08094 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1512207296" status: 202 len: 0 microversion: 2.1 time: 0.035470 Aug 10 13:42:46.316027 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 353/675] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Aug 10 13:42:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1512207296 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 13:42:46.336053 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ea2a879c-c99b-4f08-bf7b-3b04d56b18bc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:46.336570 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ea2a879c-c99b-4f08-bf7b-3b04d56b18bc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:46.337066 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ea2a879c-c99b-4f08-bf7b-3b04d56b18bc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:46.337560 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.objects.instance [None req-ea2a879c-c99b-4f08-bf7b-3b04d56b18bc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lazy-loading 'fault' on Instance uuid 589498ff-2901-49e5-91c2-0275f4dcf522 {{(pid=129523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:42:46.390158 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-acd7536b-e4ef-4789-ac47-f00ee1c977ab tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:46.390869 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-ea2a879c-c99b-4f08-bf7b-3b04d56b18bc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:46.392736 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-acd7536b-e4ef-4789-ac47-f00ee1c977ab tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] [instance: 9107fc16-6a2c-48ad-8612-964c3ac05c01] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:46.399258 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-ea2a879c-c99b-4f08-bf7b-3b04d56b18bc tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 200 len: 1325 microversion: 2.1 time: 0.135181 Aug 10 13:42:46.405263 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 323/676] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:46 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 1325 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:42:46.415288 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-acd7536b-e4ef-4789-ac47-f00ee1c977ab tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:46.416331 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-acd7536b-e4ef-4789-ac47-f00ee1c977ab tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:46.417047 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-acd7536b-e4ef-4789-ac47-f00ee1c977ab tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:46.417821 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-acd7536b-e4ef-4789-ac47-f00ee1c977ab tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:46.418283 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-acd7536b-e4ef-4789-ac47-f00ee1c977ab tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:46.418714 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-acd7536b-e4ef-4789-ac47-f00ee1c977ab tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:46.443501 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-5870821c-b69f-42bb-b732-c44029d131ba tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1599425877"}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:42:46.444066 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-5870821c-b69f-42bb-b732-c44029d131ba tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:46.444809 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.wsgi [None req-acd7536b-e4ef-4789-ac47-f00ee1c977ab tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] HTTP exception thrown: Instance 9107fc16-6a2c-48ad-8612-964c3ac05c01 could not be found. Aug 10 13:42:46.446590 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-acd7536b-e4ef-4789-ac47-f00ee1c977ab tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Request method failure captured: Aug 10 13:42:46.446590 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: request: GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01 HTTP/1.1 Aug 10 13:42:46.446590 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept: application/json Aug 10 13:42:46.446590 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept-Encoding: identity Aug 10 13:42:46.446590 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Connection: close Aug 10 13:42:46.446590 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Length: 0 Aug 10 13:42:46.446590 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Type: application/json Aug 10 13:42:46.446590 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Host: 10.222.0.52 Aug 10 13:42:46.446590 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Openstack-System-Scope: None Aug 10 13:42:46.446590 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: User-Agent: python-urllib3/1.26.11 Aug 10 13:42:46.446590 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Auth-Token: gAAAAABi87SyiKkY4w5thpU-lMeFOv-pupV3M4p5O_G9Bq0nw7Mt72anXX_8NpPA6bSBk3F77efaTtx9_wfsx9tfpnDHinM6_nwESAvKYqiVuXh6I6GeGsfaWe_Ya10ueo8dBFFLc_3EiOnm1SU3tp8oyoyNzcvZhdKgk0BRE0yUrE4ibPeYstg Aug 10 13:42:46.446590 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Id: None Aug 10 13:42:46.446590 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Name: None Aug 10 13:42:46.446590 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Identity-Status: Confirmed Aug 10 13:42:46.446590 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Is-Admin-Project: True Aug 10 13:42:46.446590 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Id: default Aug 10 13:42:46.446590 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Name: Default Aug 10 13:42:46.446590 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Id: d8eda7c7d6a348e08e81a6b2496b09e5 Aug 10 13:42:46.446590 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2121919159 Aug 10 13:42:46.446590 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Role: member,reader Aug 10 13:42:46.446590 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Roles: member,reader Aug 10 13:42:46.448204 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d8eda7c7d6a348e08e81a6b2496b09e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d8eda7c7d6a348e08e81a6b2496b09e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d8eda7c7d6a348e08e81a6b2496b09e5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d8eda7c7d6a348e08e81a6b2496b09e5"}]}] Aug 10 13:42:46.448204 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2121919159 Aug 10 13:42:46.448204 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Id: d8eda7c7d6a348e08e81a6b2496b09e5 Aug 10 13:42:46.448204 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2121919159 Aug 10 13:42:46.448204 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User: tempest-ServerRescueNegativeTestJSON-2121919159-project Aug 10 13:42:46.448204 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Id: default Aug 10 13:42:46.448204 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Name: Default Aug 10 13:42:46.448204 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Id: 5573338f0bd64c729c7d89345069ca6f Aug 10 13:42:46.448204 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2121919159-project Aug 10 13:42:46.448204 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: method: > Aug 10 13:42:46.448204 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: exception: Instance 9107fc16-6a2c-48ad-8612-964c3ac05c01 could not be found. Aug 10 13:42:46.448204 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: action_args: {'id': '9107fc16-6a2c-48ad-8612-964c3ac05c01'} Aug 10 13:42:46.449038 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:42:46.449038 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:42:46.449038 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:42:46.449038 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:42:46.449038 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:42:46.449038 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:42:46.449038 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:42:46.449038 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:42:46.449038 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:42:46.449038 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:42:46.449038 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9107fc16-6a2c-48ad-8612-964c3ac05c01 could not be found. Aug 10 13:42:46.449038 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:42:46.449038 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:42:46.449038 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:42:46.449038 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:42:46.449038 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:42:46.449038 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:42:46.449038 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:42:46.449038 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:42:46.449038 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:42:46.450196 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:42:46.450196 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:42:46.450196 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:42:46.450196 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:42:46.450196 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:42:46.450196 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:42:46.450196 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:42:46.450196 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9107fc16-6a2c-48ad-8612-964c3ac05c01 could not be found. Aug 10 13:42:46.450196 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:42:46.450196 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:42:46.450196 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:42:46.450196 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:42:46.450196 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:42:46.450196 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:42:46.450196 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:42:46.450196 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:42:46.450196 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9107fc16-6a2c-48ad-8612-964c3ac05c01 could not be found. Aug 10 13:42:46.450196 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:42:46.451220 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-acd7536b-e4ef-4789-ac47-f00ee1c977ab tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] Returning 404 to user: Instance 9107fc16-6a2c-48ad-8612-964c3ac05c01 could not be found. {{(pid=129522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:42:46.451220 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-acd7536b-e4ef-4789-ac47-f00ee1c977ab tempest-ServerRescueNegativeTestJSON-2121919159 tempest-ServerRescueNegativeTestJSON-2121919159-project] 10.222.0.52 "GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01" status: 404 len: 111 microversion: 2.1 time: 0.063537 Aug 10 13:42:46.451220 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 354/677] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:46 2022] GET /compute/v2.1/servers/9107fc16-6a2c-48ad-8612-964c3ac05c01 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 13:42:46.459686 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5870821c-b69f-42bb-b732-c44029d131ba tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:46.460450 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5870821c-b69f-42bb-b732-c44029d131ba tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:46.461082 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5870821c-b69f-42bb-b732-c44029d131ba tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:46.461837 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5870821c-b69f-42bb-b732-c44029d131ba tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:46.462573 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5870821c-b69f-42bb-b732-c44029d131ba tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:46.463007 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5870821c-b69f-42bb-b732-c44029d131ba tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:46.866168 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.network.security_group_api [None req-5870821c-b69f-42bb-b732-c44029d131ba tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Removing security group 050af66d-bd80-4856-b129-72cbe02f8117 from port 18644036-6089-4e3d-9098-4284e0ee683c Aug 10 13:42:47.421537 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-2040f049-77b0-457a-ae7b-6394e148d031 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:47.422181 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-2040f049-77b0-457a-ae7b-6394e148d031 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:47.429274 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2040f049-77b0-457a-ae7b-6394e148d031 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:47.429770 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2040f049-77b0-457a-ae7b-6394e148d031 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:47.430205 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2040f049-77b0-457a-ae7b-6394e148d031 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:47.430906 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2040f049-77b0-457a-ae7b-6394e148d031 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:47.431358 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2040f049-77b0-457a-ae7b-6394e148d031 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:47.431778 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2040f049-77b0-457a-ae7b-6394e148d031 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:47.445968 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.wsgi [None req-2040f049-77b0-457a-ae7b-6394e148d031 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] HTTP exception thrown: Instance 589498ff-2901-49e5-91c2-0275f4dcf522 could not be found. Aug 10 13:42:47.447484 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-2040f049-77b0-457a-ae7b-6394e148d031 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Request method failure captured: Aug 10 13:42:47.447484 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: request: GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 HTTP/1.1 Aug 10 13:42:47.447484 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept: application/json Aug 10 13:42:47.447484 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept-Encoding: identity Aug 10 13:42:47.447484 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Connection: close Aug 10 13:42:47.447484 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Length: 0 Aug 10 13:42:47.447484 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Type: application/json Aug 10 13:42:47.447484 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Host: 10.222.0.52 Aug 10 13:42:47.447484 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Openstack-System-Scope: None Aug 10 13:42:47.447484 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: User-Agent: python-urllib3/1.26.11 Aug 10 13:42:47.447484 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Auth-Token: gAAAAABi87SyBFBTkzIY0ISubWBiCPDiFQUyewnxnl7oGdfB5bLCdvtusNqIu_rxLiQmzA10NW-oLYnxkPKTRJxOWt6GCY4FSu918nxANV0rrJqErzPZFzHVcO3Q7M6u16ou_0R64Gx1Pk4MSTjnQcksYaErDaz6zlJQY8VAw20k3gMYZDkoYKE Aug 10 13:42:47.447484 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Id: None Aug 10 13:42:47.447484 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Name: None Aug 10 13:42:47.447484 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Identity-Status: Confirmed Aug 10 13:42:47.447484 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Is-Admin-Project: True Aug 10 13:42:47.447484 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Id: default Aug 10 13:42:47.447484 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Name: Default Aug 10 13:42:47.447484 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Id: 6f889848d459459484b5b5517fef576b Aug 10 13:42:47.447484 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Name: tempest-AttachVolumeTestJSON-1472892946 Aug 10 13:42:47.447484 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Role: member,reader Aug 10 13:42:47.447484 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Roles: member,reader Aug 10 13:42:47.449044 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6f889848d459459484b5b5517fef576b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6f889848d459459484b5b5517fef576b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6f889848d459459484b5b5517fef576b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6f889848d459459484b5b5517fef576b"}]}] Aug 10 13:42:47.449044 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant: tempest-AttachVolumeTestJSON-1472892946 Aug 10 13:42:47.449044 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Id: 6f889848d459459484b5b5517fef576b Aug 10 13:42:47.449044 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1472892946 Aug 10 13:42:47.449044 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User: tempest-AttachVolumeTestJSON-1472892946-project Aug 10 13:42:47.449044 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Id: default Aug 10 13:42:47.449044 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Name: Default Aug 10 13:42:47.449044 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Id: 289c7d8b89cd445a924f5ac07e85fe48 Aug 10 13:42:47.449044 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Name: tempest-AttachVolumeTestJSON-1472892946-project Aug 10 13:42:47.449044 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: method: > Aug 10 13:42:47.449044 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: exception: Instance 589498ff-2901-49e5-91c2-0275f4dcf522 could not be found. Aug 10 13:42:47.449044 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: action_args: {'id': '589498ff-2901-49e5-91c2-0275f4dcf522'} Aug 10 13:42:47.449943 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:42:47.449943 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:42:47.449943 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:42:47.449943 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:42:47.449943 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:42:47.449943 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:42:47.449943 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:42:47.449943 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:42:47.449943 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:42:47.449943 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:42:47.449943 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 589498ff-2901-49e5-91c2-0275f4dcf522 could not be found. Aug 10 13:42:47.449943 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:42:47.449943 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:42:47.449943 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:42:47.449943 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:42:47.449943 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:42:47.449943 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:42:47.449943 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:42:47.449943 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:42:47.449943 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:42:47.451145 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:42:47.451145 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:42:47.451145 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:42:47.451145 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:42:47.451145 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:42:47.451145 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:42:47.451145 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:42:47.451145 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 589498ff-2901-49e5-91c2-0275f4dcf522 could not be found. Aug 10 13:42:47.451145 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:42:47.451145 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:42:47.451145 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:42:47.451145 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:42:47.451145 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:42:47.451145 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:42:47.451145 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:42:47.451145 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:42:47.451145 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 589498ff-2901-49e5-91c2-0275f4dcf522 could not be found. Aug 10 13:42:47.451145 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:42:47.454224 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-2040f049-77b0-457a-ae7b-6394e148d031 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Returning 404 to user: Instance 589498ff-2901-49e5-91c2-0275f4dcf522 could not be found. {{(pid=129522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:42:47.454224 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-2040f049-77b0-457a-ae7b-6394e148d031 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 404 len: 111 microversion: 2.1 time: 0.031374 Aug 10 13:42:47.454224 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 355/678] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:47 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 13:42:47.458246 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-b5399169-21a0-4663-b745-8822c5321e66 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '.version_select at 0x7f49c4535ee0>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:47.480788 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-b5399169-21a0-4663-b745-8822c5321e66 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-386222063" status: 202 len: 0 microversion: 2.1 time: 0.026260 Aug 10 13:42:47.481416 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 356/679] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Aug 10 13:42:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-386222063 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:42:47.774674 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-5870821c-b69f-42bb-b732-c44029d131ba tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "POST /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39/action" status: 202 len: 0 microversion: 2.1 time: 1.336049 Aug 10 13:42:47.779935 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 324/680] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 10 13:42:46 2022] POST /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39/action => generated 0 bytes in 1343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:42:47.806371 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-3d17dc59-1dcb-442a-ab58-a62a3afb2b1b req-fae83261-3f7a-4341-a975-82d8ce2a7c0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45a8ce5d-0dc9-426c-bf2d-d81a99e26e39", "tag": "18644036-6089-4e3d-9098-4284e0ee683c"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:42:47.823034 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-3d17dc59-1dcb-442a-ab58-a62a3afb2b1b req-fae83261-3f7a-4341-a975-82d8ce2a7c0c service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:47.824172 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-3d17dc59-1dcb-442a-ab58-a62a3afb2b1b req-fae83261-3f7a-4341-a975-82d8ce2a7c0c service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:47.824868 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-3d17dc59-1dcb-442a-ab58-a62a3afb2b1b req-fae83261-3f7a-4341-a975-82d8ce2a7c0c service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:47.838624 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-3d17dc59-1dcb-442a-ab58-a62a3afb2b1b req-fae83261-3f7a-4341-a975-82d8ce2a7c0c service nova] Creating event network-changed:18644036-6089-4e3d-9098-4284e0ee683c for instance 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 on hv-cinder-85200 Aug 10 13:42:47.845259 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-3d17dc59-1dcb-442a-ab58-a62a3afb2b1b req-fae83261-3f7a-4341-a975-82d8ce2a7c0c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042793 Aug 10 13:42:47.846826 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 357/681] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:42:47.978173 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-3361daea-ac4f-4d6a-a923-f2f59577670f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Action: 'create', calling method: .version_select at 0x7f49c4495550>, body: {"keypair": {"name": "tempest-keypair-2105523620", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAo8UDFryTUYzu5Zz2dTOazutvHggqBgV40ZNInYbKKHgrtgmK5hUP9WXgmFuP1gCGzqJW9EQTxN9p+oZE0rR6kjuBcSgfsqEI+3psrAl0x6jMMV5Quj3Uy6ARVc/4hRQ=="}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:42:47.988513 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:42:48.012602 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-3361daea-ac4f-4d6a-a923-f2f59577670f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Getting quotas for project 48e5556cbbfd4b00aa4f6055cd6238b2. Resources: {'key_pairs'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:42:48.026550 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-3361daea-ac4f-4d6a-a923-f2f59577670f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Getting quotas for user a3d9e5dc719c430eac6b5c8d8b814566 and project 48e5556cbbfd4b00aa4f6055cd6238b2. Resources: {'key_pairs'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:42:48.100578 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-3361daea-ac4f-4d6a-a923-f2f59577670f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.127689 Aug 10 13:42:48.108531 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 325/682] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Aug 10 13:42:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:42:49.522420 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-25ebfb2a-f3ff-4abb-afd4-305bf0b75139 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Action: 'create', calling method: .version_select at 0x7f49c45dc790>, body: {"keypair": {"name": "tempest-keypair-1870924499", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeOKHglKHwokgZaeNDCXX2GEhQYDOeMXODXSsGIpxvOkstE1s3FP8srGkd/KDJjKmzS+wKYI4RzyY9x67ySdB11CFRVRJAJiZcoEuL6b/pP+fFbhYhAR32qu9qb7OaJ/g=="}} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:42:49.541390 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.quota [None req-25ebfb2a-f3ff-4abb-afd4-305bf0b75139 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Getting quotas for project 6f889848d459459484b5b5517fef576b. Resources: {'key_pairs'} {{(pid=129522) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:42:49.545767 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.quota [None req-25ebfb2a-f3ff-4abb-afd4-305bf0b75139 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Getting quotas for user 289c7d8b89cd445a924f5ac07e85fe48 and project 6f889848d459459484b5b5517fef576b. Resources: {'key_pairs'} {{(pid=129522) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:42:49.579573 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-25ebfb2a-f3ff-4abb-afd4-305bf0b75139 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.065035 Aug 10 13:42:49.580730 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 358/683] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Aug 10 13:42:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:42:50.064625 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-6d9be9d9-e741-4e77-b0a7-9c3075b9d0af tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-449727873", "imageRef": "096d81df-12b1-4175-b914-babe0fa931c6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a2798d25-3b5d-43fb-8ba3-2bd216907bcd"}], "security_groups": [{"name": "tempest-securitygroup--1291994192"}], "key_name": "tempest-keypair-2105523620", "user_data": "}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:42:50.293454 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.network.neutron [None req-6d9be9d9-e741-4e77-b0a7-9c3075b9d0af tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] validate_networks() for [('a2798d25-3b5d-43fb-8ba3-2bd216907bcd', None, None, None, None, None)] {{(pid=129523) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:42:50.505463 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-5afeac09-e056-4ad4-96d9-4f9182bef352 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:50.506201 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-5afeac09-e056-4ad4-96d9-4f9182bef352 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:50.513672 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5afeac09-e056-4ad4-96d9-4f9182bef352 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:50.517595 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5afeac09-e056-4ad4-96d9-4f9182bef352 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:50.518139 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5afeac09-e056-4ad4-96d9-4f9182bef352 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:50.518954 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5afeac09-e056-4ad4-96d9-4f9182bef352 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:50.527034 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5afeac09-e056-4ad4-96d9-4f9182bef352 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:50.528328 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5afeac09-e056-4ad4-96d9-4f9182bef352 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:50.634916 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.objects.instance [None req-5afeac09-e056-4ad4-96d9-4f9182bef352 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lazy-loading 'services' on Instance uuid 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 {{(pid=129522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:42:50.728314 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-5afeac09-e056-4ad4-96d9-4f9182bef352 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "DELETE /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39/os-volume_attachments/d3e83afa-5774-499c-b774-0175115d8db1" status: 202 len: 0 microversion: 2.1 time: 0.226678 Aug 10 13:42:50.730328 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 359/684] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Aug 10 13:42:50 2022] DELETE /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39/os-volume_attachments/d3e83afa-5774-499c-b774-0175115d8db1 => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:42:50.755141 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-f64164a0-180e-4dd0-8f90-0db93b1a09b8 req-b8a2e613-3e74-4317-9098-96a3045e63f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45a8ce5d-0dc9-426c-bf2d-d81a99e26e39", "tag": "18644036-6089-4e3d-9098-4284e0ee683c"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:42:50.769808 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-f64164a0-180e-4dd0-8f90-0db93b1a09b8 req-b8a2e613-3e74-4317-9098-96a3045e63f1 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:50.770748 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-f64164a0-180e-4dd0-8f90-0db93b1a09b8 req-b8a2e613-3e74-4317-9098-96a3045e63f1 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:50.771360 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-f64164a0-180e-4dd0-8f90-0db93b1a09b8 req-b8a2e613-3e74-4317-9098-96a3045e63f1 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:50.811445 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-f64164a0-180e-4dd0-8f90-0db93b1a09b8 req-b8a2e613-3e74-4317-9098-96a3045e63f1 service nova] Creating event network-changed:18644036-6089-4e3d-9098-4284e0ee683c for instance 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 on hv-cinder-85200 Aug 10 13:42:50.829801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-f64164a0-180e-4dd0-8f90-0db93b1a09b8 req-b8a2e613-3e74-4317-9098-96a3045e63f1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097461 Aug 10 13:42:50.830415 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 360/685] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:42:50.835552 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-40fbe4d1-e7ed-4cf3-9ecf-09ba824cdcf4 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:50.860349 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-40fbe4d1-e7ed-4cf3-9ecf-09ba824cdcf4 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:50.875289 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-40fbe4d1-e7ed-4cf3-9ecf-09ba824cdcf4 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:50.875964 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-40fbe4d1-e7ed-4cf3-9ecf-09ba824cdcf4 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:50.876507 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-40fbe4d1-e7ed-4cf3-9ecf-09ba824cdcf4 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:50.877850 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-40fbe4d1-e7ed-4cf3-9ecf-09ba824cdcf4 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:50.880050 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-40fbe4d1-e7ed-4cf3-9ecf-09ba824cdcf4 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:50.883158 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-40fbe4d1-e7ed-4cf3-9ecf-09ba824cdcf4 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:50.940931 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-6d9be9d9-e741-4e77-b0a7-9c3075b9d0af tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Flavor limits 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:42:50.941618 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-6d9be9d9-e741-4e77-b0a7-9c3075b9d0af tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Image limits 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:42:50.942269 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-6d9be9d9-e741-4e77-b0a7-9c3075b9d0af tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Flavor pref 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:42:50.942835 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-6d9be9d9-e741-4e77-b0a7-9c3075b9d0af tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Image pref 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:42:50.943412 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-6d9be9d9-e741-4e77-b0a7-9c3075b9d0af tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:42:50.944024 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-40fbe4d1-e7ed-4cf3-9ecf-09ba824cdcf4 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112312 Aug 10 13:42:50.945126 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 361/686] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 10 13:42:50 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:42:50.958273 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6d9be9d9-e741-4e77-b0a7-9c3075b9d0af tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:50.959015 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6d9be9d9-e741-4e77-b0a7-9c3075b9d0af tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:50.959619 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6d9be9d9-e741-4e77-b0a7-9c3075b9d0af tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:50.960519 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6d9be9d9-e741-4e77-b0a7-9c3075b9d0af tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:50.961141 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6d9be9d9-e741-4e77-b0a7-9c3075b9d0af tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:50.961759 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6d9be9d9-e741-4e77-b0a7-9c3075b9d0af tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:50.979456 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-6d9be9d9-e741-4e77-b0a7-9c3075b9d0af tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Getting quotas for project 48e5556cbbfd4b00aa4f6055cd6238b2. Resources: {'cores', 'ram', 'instances'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:42:50.983805 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-6d9be9d9-e741-4e77-b0a7-9c3075b9d0af tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Getting quotas for user a3d9e5dc719c430eac6b5c8d8b814566 and project 48e5556cbbfd4b00aa4f6055cd6238b2. Resources: {'cores', 'ram', 'instances'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:42:50.996072 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-6d9be9d9-e741-4e77-b0a7-9c3075b9d0af tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Going to run 1 instances... {{(pid=129523) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:42:50.998663 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-6d9be9d9-e741-4e77-b0a7-9c3075b9d0af tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 59cf654d-76ac-488e-93ff-ccb46e164602] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='096d81df-12b1-4175-b914-babe0fa931c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:42:51.063336 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-6d9be9d9-e741-4e77-b0a7-9c3075b9d0af tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.004458 Aug 10 13:42:51.064651 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 326/687] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 10 13:42:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 1007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 13:42:51.075716 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-df778280-526c-415c-aa14-fd4a3fe8f62c tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:51.076697 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-df778280-526c-415c-aa14-fd4a3fe8f62c tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 59cf654d-76ac-488e-93ff-ccb46e164602] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:51.304357 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-df778280-526c-415c-aa14-fd4a3fe8f62c tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:51.321508 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-df778280-526c-415c-aa14-fd4a3fe8f62c tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602" status: 200 len: 1241 microversion: 2.1 time: 0.249688 Aug 10 13:42:51.323741 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 362/688] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:51 2022] GET /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602 => generated 1241 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:51.958255 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-e93413f0-f14e-4a94-b0e0-1c1fbd5f89c1 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:51.960726 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-e93413f0-f14e-4a94-b0e0-1c1fbd5f89c1 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:51.971907 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e93413f0-f14e-4a94-b0e0-1c1fbd5f89c1 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:51.972685 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e93413f0-f14e-4a94-b0e0-1c1fbd5f89c1 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:51.973547 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e93413f0-f14e-4a94-b0e0-1c1fbd5f89c1 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:51.975428 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e93413f0-f14e-4a94-b0e0-1c1fbd5f89c1 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:51.976361 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e93413f0-f14e-4a94-b0e0-1c1fbd5f89c1 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:51.977470 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e93413f0-f14e-4a94-b0e0-1c1fbd5f89c1 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:52.048258 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-e93413f0-f14e-4a94-b0e0-1c1fbd5f89c1 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.095949 Aug 10 13:42:52.048883 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 327/689] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 10 13:42:51 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39/os-volume_attachments => generated 25 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 13:42:52.060188 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-32410eff-d376-4e9f-a116-67084c5d2b19 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:52.061353 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-32410eff-d376-4e9f-a116-67084c5d2b19 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:52.075198 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-32410eff-d376-4e9f-a116-67084c5d2b19 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:52.075705 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-32410eff-d376-4e9f-a116-67084c5d2b19 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:52.076143 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-32410eff-d376-4e9f-a116-67084c5d2b19 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:52.076848 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-32410eff-d376-4e9f-a116-67084c5d2b19 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:52.081061 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-32410eff-d376-4e9f-a116-67084c5d2b19 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:52.081623 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-32410eff-d376-4e9f-a116-67084c5d2b19 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:52.197476 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.wsgi [None req-32410eff-d376-4e9f-a116-67084c5d2b19 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] HTTP exception thrown: Instance 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 is not attached to volume d3e83afa-5774-499c-b774-0175115d8db1 Aug 10 13:42:52.201923 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-32410eff-d376-4e9f-a116-67084c5d2b19 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Request method failure captured: Aug 10 13:42:52.201923 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: request: DELETE /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39/os-volume_attachments/d3e83afa-5774-499c-b774-0175115d8db1 HTTP/1.1 Aug 10 13:42:52.201923 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept: application/json Aug 10 13:42:52.201923 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept-Encoding: identity Aug 10 13:42:52.201923 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Connection: close Aug 10 13:42:52.201923 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Length: 0 Aug 10 13:42:52.201923 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Type: application/json Aug 10 13:42:52.201923 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Host: 10.222.0.52 Aug 10 13:42:52.201923 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Openstack-System-Scope: None Aug 10 13:42:52.201923 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: User-Agent: python-urllib3/1.26.11 Aug 10 13:42:52.201923 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Auth-Token: gAAAAABi87UlQOyS7grS2UAm4nxQoR1hAH43GoNtvRi7P6DJX5Xyy6pw5YZRhuL60SOowJqLjvA96F8TKm89Mx8OLGRCnEgELjZ-aOprhH-ht4LhUVofFr_c9_HBfv0h0J47EuSsYh25rrbmoPF3ksaPCDfkSBD2gO7eaJY6Q3xjTJ8QFSOKQsk Aug 10 13:42:52.201923 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Id: None Aug 10 13:42:52.201923 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Name: None Aug 10 13:42:52.201923 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Identity-Status: Confirmed Aug 10 13:42:52.201923 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Is-Admin-Project: True Aug 10 13:42:52.201923 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Id: default Aug 10 13:42:52.201923 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Name: Default Aug 10 13:42:52.201923 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Id: 2158cd74bdb44c47a905e34e97c5807f Aug 10 13:42:52.201923 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Name: tempest-TestMinimumBasicScenario-658161700 Aug 10 13:42:52.201923 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Role: member,reader Aug 10 13:42:52.201923 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Roles: member,reader Aug 10 13:42:52.204108 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2158cd74bdb44c47a905e34e97c5807f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2158cd74bdb44c47a905e34e97c5807f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2158cd74bdb44c47a905e34e97c5807f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2158cd74bdb44c47a905e34e97c5807f"}]}] Aug 10 13:42:52.204108 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant: tempest-TestMinimumBasicScenario-658161700 Aug 10 13:42:52.204108 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Id: 2158cd74bdb44c47a905e34e97c5807f Aug 10 13:42:52.204108 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Name: tempest-TestMinimumBasicScenario-658161700 Aug 10 13:42:52.204108 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User: tempest-TestMinimumBasicScenario-658161700-project Aug 10 13:42:52.204108 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Id: default Aug 10 13:42:52.204108 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Name: Default Aug 10 13:42:52.204108 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Id: ccc10397cf6a4b9084bcd6cdb12b8607 Aug 10 13:42:52.204108 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Name: tempest-TestMinimumBasicScenario-658161700-project Aug 10 13:42:52.204108 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: method: > Aug 10 13:42:52.204108 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: exception: Instance 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 is not attached to volume d3e83afa-5774-499c-b774-0175115d8db1 Aug 10 13:42:52.204924 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: action_args: {'server_id': '45a8ce5d-0dc9-426c-bf2d-d81a99e26e39', 'id': 'd3e83afa-5774-499c-b774-0175115d8db1'} Aug 10 13:42:52.204924 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:42:52.204924 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:42:52.204924 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 10 13:42:52.204924 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 10 13:42:52.204924 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 13:42:52.204924 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 13:42:52.204924 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 10 13:42:52.204924 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 10 13:42:52.204924 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d3e83afa-5774-499c-b774-0175115d8db1. Aug 10 13:42:52.204924 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:42:52.204924 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:42:52.204924 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:42:52.204924 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:42:52.204924 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:42:52.204924 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:42:52.204924 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:42:52.204924 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:42:52.204924 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:42:52.207432 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:42:52.207432 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 10 13:42:52.207432 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 10 13:42:52.207432 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 is not attached to volume d3e83afa-5774-499c-b774-0175115d8db1 Aug 10 13:42:52.207432 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:42:52.207432 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:42:52.207432 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:42:52.207432 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:42:52.207432 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:42:52.207432 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:42:52.207432 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:42:52.207432 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:42:52.207432 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 is not attached to volume d3e83afa-5774-499c-b774-0175115d8db1 Aug 10 13:42:52.207432 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:42:52.207432 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-32410eff-d376-4e9f-a116-67084c5d2b19 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Returning 404 to user: Instance 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 is not attached to volume d3e83afa-5774-499c-b774-0175115d8db1 {{(pid=129522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:42:52.209060 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-32410eff-d376-4e9f-a116-67084c5d2b19 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "DELETE /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39/os-volume_attachments/d3e83afa-5774-499c-b774-0175115d8db1" status: 404 len: 154 microversion: 2.1 time: 0.149499 Aug 10 13:42:52.209060 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 363/690] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Aug 10 13:42:52 2022] DELETE /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39/os-volume_attachments/d3e83afa-5774-499c-b774-0175115d8db1 => generated 154 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:42:52.344012 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-675fd2d7-1fd5-43a7-b64e-38b548434e61 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:52.345335 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-675fd2d7-1fd5-43a7-b64e-38b548434e61 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 59cf654d-76ac-488e-93ff-ccb46e164602] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:52.352013 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-675fd2d7-1fd5-43a7-b64e-38b548434e61 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:52.352531 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-675fd2d7-1fd5-43a7-b64e-38b548434e61 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:52.352994 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-675fd2d7-1fd5-43a7-b64e-38b548434e61 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:52.353791 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-675fd2d7-1fd5-43a7-b64e-38b548434e61 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:52.354314 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-675fd2d7-1fd5-43a7-b64e-38b548434e61 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:52.354757 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-675fd2d7-1fd5-43a7-b64e-38b548434e61 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:52.734559 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-d6881357-873e-43e6-9d6c-f91a94d24ea0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1196027479", "imageRef": "096d81df-12b1-4175-b914-babe0fa931c6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5e135556-dff2-48f9-a0d1-213f45a15473"}], "security_groups": [{"name": "tempest-securitygroup--1105905385"}], "key_name": "tempest-keypair-1870924499", "user_data": "}} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:42:52.797353 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-675fd2d7-1fd5-43a7-b64e-38b548434e61 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:52.810955 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-675fd2d7-1fd5-43a7-b64e-38b548434e61 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602" status: 200 len: 1293 microversion: 2.1 time: 0.471499 Aug 10 13:42:52.813445 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 328/691] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:52 2022] GET /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602 => generated 1293 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:52.984960 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.network.neutron [None req-d6881357-873e-43e6-9d6c-f91a94d24ea0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] validate_networks() for [('5e135556-dff2-48f9-a0d1-213f45a15473', None, None, None, None, None)] {{(pid=129522) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:42:53.423462 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-8388db98-d9b3-4f9d-81b4-912c5e1985e4 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:53.423979 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-8388db98-d9b3-4f9d-81b4-912c5e1985e4 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:53.431407 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8388db98-d9b3-4f9d-81b4-912c5e1985e4 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:53.431943 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8388db98-d9b3-4f9d-81b4-912c5e1985e4 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:53.432377 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8388db98-d9b3-4f9d-81b4-912c5e1985e4 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:53.433082 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8388db98-d9b3-4f9d-81b4-912c5e1985e4 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:53.433754 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8388db98-d9b3-4f9d-81b4-912c5e1985e4 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:53.434181 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8388db98-d9b3-4f9d-81b4-912c5e1985e4 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:53.463711 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-8388db98-d9b3-4f9d-81b4-912c5e1985e4 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Going to try to terminate instance {{(pid=129523) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:42:53.591842 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-8388db98-d9b3-4f9d-81b4-912c5e1985e4 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "DELETE /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 204 len: 0 microversion: 2.1 time: 0.174936 Aug 10 13:42:53.596891 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 329/692] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 10 13:42:53 2022] DELETE /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:42:53.604763 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-c59c4a51-2761-43af-a3ac-e304a6af0c9f tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:53.605929 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-c59c4a51-2761-43af-a3ac-e304a6af0c9f tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:53.626656 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c59c4a51-2761-43af-a3ac-e304a6af0c9f tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:53.627397 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c59c4a51-2761-43af-a3ac-e304a6af0c9f tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:53.628050 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c59c4a51-2761-43af-a3ac-e304a6af0c9f tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:53.629263 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c59c4a51-2761-43af-a3ac-e304a6af0c9f tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:53.630114 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c59c4a51-2761-43af-a3ac-e304a6af0c9f tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:53.630706 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c59c4a51-2761-43af-a3ac-e304a6af0c9f tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:53.829828 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-c59c4a51-2761-43af-a3ac-e304a6af0c9f tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:53.839709 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-c59c4a51-2761-43af-a3ac-e304a6af0c9f tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1554 microversion: 2.1 time: 0.241251 Aug 10 13:42:53.841188 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 330/693] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:53 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1554 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:53.848283 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-bbcd7934-7385-4c03-a55d-05b17548d5b1 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:53.849451 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-bbcd7934-7385-4c03-a55d-05b17548d5b1 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 59cf654d-76ac-488e-93ff-ccb46e164602] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:53.867828 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bbcd7934-7385-4c03-a55d-05b17548d5b1 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:53.868345 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bbcd7934-7385-4c03-a55d-05b17548d5b1 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:53.868901 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bbcd7934-7385-4c03-a55d-05b17548d5b1 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:53.869552 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bbcd7934-7385-4c03-a55d-05b17548d5b1 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:53.870008 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bbcd7934-7385-4c03-a55d-05b17548d5b1 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:53.870434 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bbcd7934-7385-4c03-a55d-05b17548d5b1 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:53.953456 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.virt.hardware [None req-d6881357-873e-43e6-9d6c-f91a94d24ea0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Flavor limits 0:0:0 {{(pid=129522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:42:53.953939 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.virt.hardware [None req-d6881357-873e-43e6-9d6c-f91a94d24ea0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Image limits 0:0:0 {{(pid=129522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:42:53.955236 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.virt.hardware [None req-d6881357-873e-43e6-9d6c-f91a94d24ea0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Flavor pref 0:0:0 {{(pid=129522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:42:53.955657 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.virt.hardware [None req-d6881357-873e-43e6-9d6c-f91a94d24ea0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Image pref 0:0:0 {{(pid=129522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:42:53.956462 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.virt.hardware [None req-d6881357-873e-43e6-9d6c-f91a94d24ea0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:42:53.972460 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d6881357-873e-43e6-9d6c-f91a94d24ea0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:53.973194 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d6881357-873e-43e6-9d6c-f91a94d24ea0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:53.973728 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d6881357-873e-43e6-9d6c-f91a94d24ea0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:53.974543 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d6881357-873e-43e6-9d6c-f91a94d24ea0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:53.975075 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d6881357-873e-43e6-9d6c-f91a94d24ea0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:53.975616 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d6881357-873e-43e6-9d6c-f91a94d24ea0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:54.013347 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.quota [None req-d6881357-873e-43e6-9d6c-f91a94d24ea0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Getting quotas for project 6f889848d459459484b5b5517fef576b. Resources: {'cores', 'ram', 'instances'} {{(pid=129522) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:42:54.018602 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.quota [None req-d6881357-873e-43e6-9d6c-f91a94d24ea0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Getting quotas for user 289c7d8b89cd445a924f5ac07e85fe48 and project 6f889848d459459484b5b5517fef576b. Resources: {'cores', 'ram', 'instances'} {{(pid=129522) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:42:54.022865 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:42:54.034009 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-d6881357-873e-43e6-9d6c-f91a94d24ea0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Going to run 1 instances... {{(pid=129522) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:42:54.036649 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-d6881357-873e-43e6-9d6c-f91a94d24ea0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 3d30c2bb-a513-4a88-a9e4-3cf892bda262] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='096d81df-12b1-4175-b914-babe0fa931c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129522) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:42:54.059262 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-bbcd7934-7385-4c03-a55d-05b17548d5b1 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:54.070201 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-bbcd7934-7385-4c03-a55d-05b17548d5b1 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602" status: 200 len: 1367 microversion: 2.1 time: 0.227077 Aug 10 13:42:54.071712 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 331/694] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:53 2022] GET /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:54.097343 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-d6881357-873e-43e6-9d6c-f91a94d24ea0 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.368065 Aug 10 13:42:54.103651 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 364/695] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 10 13:42:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 1370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 13:42:54.110331 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-1debefd4-5f24-4f15-9317-c69faaa18e38 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:54.110946 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-1debefd4-5f24-4f15-9317-c69faaa18e38 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 3d30c2bb-a513-4a88-a9e4-3cf892bda262] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:54.170842 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-1debefd4-5f24-4f15-9317-c69faaa18e38 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:54.180849 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-1debefd4-5f24-4f15-9317-c69faaa18e38 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262" status: 200 len: 1238 microversion: 2.1 time: 0.074791 Aug 10 13:42:54.181867 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 332/696] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:54 2022] GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262 => generated 1238 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:54.863385 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-5bcb2e4f-28b9-4b78-9735-1308e756fc9d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:54.863911 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-5bcb2e4f-28b9-4b78-9735-1308e756fc9d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:54.870094 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5bcb2e4f-28b9-4b78-9735-1308e756fc9d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:54.870635 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5bcb2e4f-28b9-4b78-9735-1308e756fc9d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:54.871078 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5bcb2e4f-28b9-4b78-9735-1308e756fc9d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:54.871839 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5bcb2e4f-28b9-4b78-9735-1308e756fc9d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:54.872295 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5bcb2e4f-28b9-4b78-9735-1308e756fc9d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:54.872718 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5bcb2e4f-28b9-4b78-9735-1308e756fc9d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:55.021589 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-5bcb2e4f-28b9-4b78-9735-1308e756fc9d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:55.029683 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-5bcb2e4f-28b9-4b78-9735-1308e756fc9d tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1554 microversion: 2.1 time: 0.170814 Aug 10 13:42:55.030270 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 365/697] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:54 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:55.091756 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-08772dda-e1e9-43f6-9c35-7c4d674bcd92 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:55.092804 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-08772dda-e1e9-43f6-9c35-7c4d674bcd92 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 59cf654d-76ac-488e-93ff-ccb46e164602] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:55.100186 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-08772dda-e1e9-43f6-9c35-7c4d674bcd92 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:55.100683 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-08772dda-e1e9-43f6-9c35-7c4d674bcd92 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:55.101122 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-08772dda-e1e9-43f6-9c35-7c4d674bcd92 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:55.101852 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-08772dda-e1e9-43f6-9c35-7c4d674bcd92 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:55.102312 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-08772dda-e1e9-43f6-9c35-7c4d674bcd92 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:55.102955 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-08772dda-e1e9-43f6-9c35-7c4d674bcd92 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:55.201867 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-e978626d-23e0-4b57-8f5b-2c8f1d37c463 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:55.202682 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-e978626d-23e0-4b57-8f5b-2c8f1d37c463 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 3d30c2bb-a513-4a88-a9e4-3cf892bda262] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:55.209719 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e978626d-23e0-4b57-8f5b-2c8f1d37c463 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:55.210370 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e978626d-23e0-4b57-8f5b-2c8f1d37c463 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:55.210913 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e978626d-23e0-4b57-8f5b-2c8f1d37c463 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:55.211935 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e978626d-23e0-4b57-8f5b-2c8f1d37c463 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:55.212468 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e978626d-23e0-4b57-8f5b-2c8f1d37c463 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:55.212992 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e978626d-23e0-4b57-8f5b-2c8f1d37c463 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:55.244125 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-08772dda-e1e9-43f6-9c35-7c4d674bcd92 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:55.252635 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-08772dda-e1e9-43f6-9c35-7c4d674bcd92 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602" status: 200 len: 1367 microversion: 2.1 time: 0.164550 Aug 10 13:42:55.253494 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 333/698] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:55 2022] GET /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:55.296726 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-e978626d-23e0-4b57-8f5b-2c8f1d37c463 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:55.306458 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-e978626d-23e0-4b57-8f5b-2c8f1d37c463 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262" status: 200 len: 1242 microversion: 2.1 time: 0.108196 Aug 10 13:42:55.307655 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 366/699] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:55 2022] GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262 => generated 1242 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:42:55.893634 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-046128ea-802c-47cd-a5c1-aba794ab0074 req-65384ea4-c191-4776-8eec-4c62177993d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59cf654d-76ac-488e-93ff-ccb46e164602", "tag": "4a041ea6-0120-4d1d-86df-1010d3fafa8b"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:42:55.906475 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-046128ea-802c-47cd-a5c1-aba794ab0074 req-65384ea4-c191-4776-8eec-4c62177993d6 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:55.906960 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-046128ea-802c-47cd-a5c1-aba794ab0074 req-65384ea4-c191-4776-8eec-4c62177993d6 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:55.907394 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-046128ea-802c-47cd-a5c1-aba794ab0074 req-65384ea4-c191-4776-8eec-4c62177993d6 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:55.923681 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-046128ea-802c-47cd-a5c1-aba794ab0074 req-65384ea4-c191-4776-8eec-4c62177993d6 service nova] Creating event network-changed:4a041ea6-0120-4d1d-86df-1010d3fafa8b for instance 59cf654d-76ac-488e-93ff-ccb46e164602 on hv-cinder-85200 Aug 10 13:42:55.928643 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-046128ea-802c-47cd-a5c1-aba794ab0074 req-65384ea4-c191-4776-8eec-4c62177993d6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040089 Aug 10 13:42:55.930010 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 334/700] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:42:56.053104 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-1acc8b02-224d-4aca-b697-e2e4f48c9825 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:56.062325 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-1acc8b02-224d-4aca-b697-e2e4f48c9825 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:56.076568 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1acc8b02-224d-4aca-b697-e2e4f48c9825 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:56.083770 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1acc8b02-224d-4aca-b697-e2e4f48c9825 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:56.084897 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1acc8b02-224d-4aca-b697-e2e4f48c9825 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:56.085945 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1acc8b02-224d-4aca-b697-e2e4f48c9825 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:56.086761 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1acc8b02-224d-4aca-b697-e2e4f48c9825 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:56.087346 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1acc8b02-224d-4aca-b697-e2e4f48c9825 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:56.275470 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-7089c89c-b15f-49ba-829f-453d3cad9b08 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:56.276259 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-7089c89c-b15f-49ba-829f-453d3cad9b08 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 59cf654d-76ac-488e-93ff-ccb46e164602] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:56.290024 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7089c89c-b15f-49ba-829f-453d3cad9b08 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:56.290520 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7089c89c-b15f-49ba-829f-453d3cad9b08 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:56.290967 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7089c89c-b15f-49ba-829f-453d3cad9b08 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:56.291683 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7089c89c-b15f-49ba-829f-453d3cad9b08 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:56.296682 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7089c89c-b15f-49ba-829f-453d3cad9b08 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:56.297502 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7089c89c-b15f-49ba-829f-453d3cad9b08 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:56.587861 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-1acc8b02-224d-4aca-b697-e2e4f48c9825 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:56.598534 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-1acc8b02-224d-4aca-b697-e2e4f48c9825 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1554 microversion: 2.1 time: 0.550525 Aug 10 13:42:56.608960 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 367/701] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:56 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1554 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:56.608960 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-175ad682-0f5d-4ca7-8dab-8dfeaaf25926 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:56.608960 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-175ad682-0f5d-4ca7-8dab-8dfeaaf25926 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 3d30c2bb-a513-4a88-a9e4-3cf892bda262] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:56.612138 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-7089c89c-b15f-49ba-829f-453d3cad9b08 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:56.615175 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-175ad682-0f5d-4ca7-8dab-8dfeaaf25926 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:56.615679 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-175ad682-0f5d-4ca7-8dab-8dfeaaf25926 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:56.616322 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-175ad682-0f5d-4ca7-8dab-8dfeaaf25926 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:56.617139 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-175ad682-0f5d-4ca7-8dab-8dfeaaf25926 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:56.617690 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-175ad682-0f5d-4ca7-8dab-8dfeaaf25926 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:56.618166 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-175ad682-0f5d-4ca7-8dab-8dfeaaf25926 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:56.622657 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-7089c89c-b15f-49ba-829f-453d3cad9b08 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602" status: 200 len: 1367 microversion: 2.1 time: 0.351507 Aug 10 13:42:56.624637 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 335/702] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:56 2022] GET /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602 => generated 1367 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:42:56.775754 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-175ad682-0f5d-4ca7-8dab-8dfeaaf25926 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:56.790981 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-eb0f07ac-002b-460d-8690-a28cb0e6bd63 req-bcbb745c-3bb2-4425-824b-6bd9d114edcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45a8ce5d-0dc9-426c-bf2d-d81a99e26e39", "name": "network-vif-deleted", "tag": "18644036-6089-4e3d-9098-4284e0ee683c"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:42:56.809144 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-175ad682-0f5d-4ca7-8dab-8dfeaaf25926 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262" status: 200 len: 1296 microversion: 2.1 time: 0.204013 Aug 10 13:42:56.813079 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 368/703] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:56 2022] GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262 => generated 1296 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:56.819071 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-eb0f07ac-002b-460d-8690-a28cb0e6bd63 req-bcbb745c-3bb2-4425-824b-6bd9d114edcd service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:56.822484 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-eb0f07ac-002b-460d-8690-a28cb0e6bd63 req-bcbb745c-3bb2-4425-824b-6bd9d114edcd service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:56.823027 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-eb0f07ac-002b-460d-8690-a28cb0e6bd63 req-bcbb745c-3bb2-4425-824b-6bd9d114edcd service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:56.842435 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-eb0f07ac-002b-460d-8690-a28cb0e6bd63 req-bcbb745c-3bb2-4425-824b-6bd9d114edcd service nova] Creating event network-vif-deleted:18644036-6089-4e3d-9098-4284e0ee683c for instance 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 on hv-cinder-85200 Aug 10 13:42:56.849087 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-eb0f07ac-002b-460d-8690-a28cb0e6bd63 req-bcbb745c-3bb2-4425-824b-6bd9d114edcd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062393 Aug 10 13:42:56.850449 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 336/704] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:42:57.624044 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-2533695e-257e-4a5f-9bc4-929b722351d3 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:57.625478 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-2533695e-257e-4a5f-9bc4-929b722351d3 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:57.632859 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2533695e-257e-4a5f-9bc4-929b722351d3 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:57.633418 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2533695e-257e-4a5f-9bc4-929b722351d3 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:57.633878 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2533695e-257e-4a5f-9bc4-929b722351d3 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:57.634629 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2533695e-257e-4a5f-9bc4-929b722351d3 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:57.635149 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2533695e-257e-4a5f-9bc4-929b722351d3 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:57.635636 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2533695e-257e-4a5f-9bc4-929b722351d3 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:57.647211 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-438a28f6-bb1b-4784-8a7a-7f6264a61248 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:57.647928 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-438a28f6-bb1b-4784-8a7a-7f6264a61248 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 59cf654d-76ac-488e-93ff-ccb46e164602] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:57.654145 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-438a28f6-bb1b-4784-8a7a-7f6264a61248 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:57.654795 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-438a28f6-bb1b-4784-8a7a-7f6264a61248 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:57.655996 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-438a28f6-bb1b-4784-8a7a-7f6264a61248 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:57.656903 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-438a28f6-bb1b-4784-8a7a-7f6264a61248 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:57.657404 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-438a28f6-bb1b-4784-8a7a-7f6264a61248 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:57.657836 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-438a28f6-bb1b-4784-8a7a-7f6264a61248 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:57.670598 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2533695e-257e-4a5f-9bc4-929b722351d3 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:57.671694 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2533695e-257e-4a5f-9bc4-929b722351d3 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:57.672130 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2533695e-257e-4a5f-9bc4-929b722351d3 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:57.672773 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.objects.instance [None req-2533695e-257e-4a5f-9bc4-929b722351d3 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lazy-loading 'fault' on Instance uuid 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 {{(pid=129522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:42:57.745692 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-2533695e-257e-4a5f-9bc4-929b722351d3 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc10397cf6a4b9084bcd6cdb12b8607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2158cd74bdb44c47a905e34e97c5807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:57.763682 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-2533695e-257e-4a5f-9bc4-929b722351d3 tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 200 len: 1348 microversion: 2.1 time: 0.144480 Aug 10 13:42:57.766308 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 369/705] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:57 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 1348 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:57.840771 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-8afe1940-4357-4420-8d82-29e12f47608d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:57.841440 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-8afe1940-4357-4420-8d82-29e12f47608d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 3d30c2bb-a513-4a88-a9e4-3cf892bda262] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:57.848281 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8afe1940-4357-4420-8d82-29e12f47608d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:57.848765 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8afe1940-4357-4420-8d82-29e12f47608d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:57.849196 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8afe1940-4357-4420-8d82-29e12f47608d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:57.850071 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8afe1940-4357-4420-8d82-29e12f47608d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:57.850743 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8afe1940-4357-4420-8d82-29e12f47608d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:57.851323 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8afe1940-4357-4420-8d82-29e12f47608d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:57.911414 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-438a28f6-bb1b-4784-8a7a-7f6264a61248 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:57.919626 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-438a28f6-bb1b-4784-8a7a-7f6264a61248 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602" status: 200 len: 1367 microversion: 2.1 time: 0.277422 Aug 10 13:42:57.920215 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 337/706] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:57 2022] GET /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602 => generated 1367 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:42:58.058266 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-8afe1940-4357-4420-8d82-29e12f47608d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:58.079015 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-8afe1940-4357-4420-8d82-29e12f47608d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262" status: 200 len: 1364 microversion: 2.1 time: 0.245312 Aug 10 13:42:58.079596 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 370/707] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:57 2022] GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262 => generated 1364 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:42:58.787279 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-45ef2750-8808-40b6-a43d-400bdec36b3f tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:58.787887 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-45ef2750-8808-40b6-a43d-400bdec36b3f tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] [instance: 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:58.796432 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-45ef2750-8808-40b6-a43d-400bdec36b3f tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:58.797273 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-45ef2750-8808-40b6-a43d-400bdec36b3f tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:58.797898 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-45ef2750-8808-40b6-a43d-400bdec36b3f tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:58.799109 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-45ef2750-8808-40b6-a43d-400bdec36b3f tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:58.799577 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-45ef2750-8808-40b6-a43d-400bdec36b3f tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:58.800007 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-45ef2750-8808-40b6-a43d-400bdec36b3f tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:58.816595 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.wsgi [None req-45ef2750-8808-40b6-a43d-400bdec36b3f tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] HTTP exception thrown: Instance 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 could not be found. Aug 10 13:42:58.818602 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-45ef2750-8808-40b6-a43d-400bdec36b3f tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Request method failure captured: Aug 10 13:42:58.818602 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: request: GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 HTTP/1.1 Aug 10 13:42:58.818602 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept: application/json Aug 10 13:42:58.818602 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept-Encoding: identity Aug 10 13:42:58.818602 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Connection: close Aug 10 13:42:58.818602 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Length: 0 Aug 10 13:42:58.818602 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Type: application/json Aug 10 13:42:58.818602 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Host: 10.222.0.52 Aug 10 13:42:58.818602 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Openstack-System-Scope: None Aug 10 13:42:58.818602 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: User-Agent: python-urllib3/1.26.11 Aug 10 13:42:58.818602 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Auth-Token: gAAAAABi87UlQOyS7grS2UAm4nxQoR1hAH43GoNtvRi7P6DJX5Xyy6pw5YZRhuL60SOowJqLjvA96F8TKm89Mx8OLGRCnEgELjZ-aOprhH-ht4LhUVofFr_c9_HBfv0h0J47EuSsYh25rrbmoPF3ksaPCDfkSBD2gO7eaJY6Q3xjTJ8QFSOKQsk Aug 10 13:42:58.818602 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Id: None Aug 10 13:42:58.818602 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Name: None Aug 10 13:42:58.818602 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Identity-Status: Confirmed Aug 10 13:42:58.818602 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Is-Admin-Project: True Aug 10 13:42:58.818602 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Id: default Aug 10 13:42:58.818602 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Name: Default Aug 10 13:42:58.818602 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Id: 2158cd74bdb44c47a905e34e97c5807f Aug 10 13:42:58.818602 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Name: tempest-TestMinimumBasicScenario-658161700 Aug 10 13:42:58.818602 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Role: member,reader Aug 10 13:42:58.818602 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Roles: member,reader Aug 10 13:42:58.820298 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2158cd74bdb44c47a905e34e97c5807f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2158cd74bdb44c47a905e34e97c5807f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2158cd74bdb44c47a905e34e97c5807f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2158cd74bdb44c47a905e34e97c5807f"}]}] Aug 10 13:42:58.820298 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant: tempest-TestMinimumBasicScenario-658161700 Aug 10 13:42:58.820298 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Id: 2158cd74bdb44c47a905e34e97c5807f Aug 10 13:42:58.820298 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Name: tempest-TestMinimumBasicScenario-658161700 Aug 10 13:42:58.820298 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User: tempest-TestMinimumBasicScenario-658161700-project Aug 10 13:42:58.820298 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Id: default Aug 10 13:42:58.820298 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Name: Default Aug 10 13:42:58.820298 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Id: ccc10397cf6a4b9084bcd6cdb12b8607 Aug 10 13:42:58.820298 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Name: tempest-TestMinimumBasicScenario-658161700-project Aug 10 13:42:58.820298 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: method: > Aug 10 13:42:58.820298 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: exception: Instance 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 could not be found. Aug 10 13:42:58.820298 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: action_args: {'id': '45a8ce5d-0dc9-426c-bf2d-d81a99e26e39'} Aug 10 13:42:58.821246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:42:58.821246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:42:58.821246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:42:58.821246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:42:58.821246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:42:58.821246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:42:58.821246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:42:58.821246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:42:58.821246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:42:58.821246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:42:58.821246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 could not be found. Aug 10 13:42:58.821246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:42:58.821246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:42:58.821246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:42:58.821246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:42:58.821246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:42:58.821246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:42:58.821246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:42:58.821246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:42:58.821246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:42:58.822708 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:42:58.822708 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:42:58.822708 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:42:58.822708 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:42:58.822708 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:42:58.822708 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:42:58.822708 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:42:58.822708 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 could not be found. Aug 10 13:42:58.822708 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:42:58.822708 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:42:58.822708 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:42:58.822708 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:42:58.822708 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:42:58.822708 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:42:58.822708 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:42:58.822708 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:42:58.822708 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 could not be found. Aug 10 13:42:58.822708 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:42:58.831844 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-45ef2750-8808-40b6-a43d-400bdec36b3f tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Returning 404 to user: Instance 45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 could not be found. {{(pid=129523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:42:58.838447 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-45ef2750-8808-40b6-a43d-400bdec36b3f tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39" status: 404 len: 111 microversion: 2.1 time: 0.054909 Aug 10 13:42:58.839580 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 338/708] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:58 2022] GET /compute/v2.1/servers/45a8ce5d-0dc9-426c-bf2d-d81a99e26e39 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:42:58.848652 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-4748ff9e-91cf-443c-96ea-a575c8c43f9e tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] Calling method '.version_select at 0x7f49c450cf70>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:58.887661 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-4748ff9e-91cf-443c-96ea-a575c8c43f9e tempest-TestMinimumBasicScenario-658161700 tempest-TestMinimumBasicScenario-658161700-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2126795437" status: 202 len: 0 microversion: 2.1 time: 0.042265 Aug 10 13:42:58.890859 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 371/709] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Aug 10 13:42:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2126795437 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:42:58.941445 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-7ba92f36-9ae5-4011-85e6-be0c9c3593b8 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:58.942323 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-7ba92f36-9ae5-4011-85e6-be0c9c3593b8 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 59cf654d-76ac-488e-93ff-ccb46e164602] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:58.957161 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7ba92f36-9ae5-4011-85e6-be0c9c3593b8 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:58.962143 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7ba92f36-9ae5-4011-85e6-be0c9c3593b8 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:58.962949 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7ba92f36-9ae5-4011-85e6-be0c9c3593b8 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:58.963877 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7ba92f36-9ae5-4011-85e6-be0c9c3593b8 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:58.966204 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7ba92f36-9ae5-4011-85e6-be0c9c3593b8 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:58.966688 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7ba92f36-9ae5-4011-85e6-be0c9c3593b8 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:59.058203 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-7eec3e09-84de-43d9-a3e0-38a2ccbc1ed5 req-d938de51-97cf-43ae-894d-7d5389bae72c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d30c2bb-a513-4a88-a9e4-3cf892bda262", "tag": "43a79878-e56a-45c7-8b88-233e7d8b4349"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:42:59.090430 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-7eec3e09-84de-43d9-a3e0-38a2ccbc1ed5 req-d938de51-97cf-43ae-894d-7d5389bae72c service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:59.090915 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-7eec3e09-84de-43d9-a3e0-38a2ccbc1ed5 req-d938de51-97cf-43ae-894d-7d5389bae72c service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:59.091347 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-7eec3e09-84de-43d9-a3e0-38a2ccbc1ed5 req-d938de51-97cf-43ae-894d-7d5389bae72c service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:59.120067 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-7eec3e09-84de-43d9-a3e0-38a2ccbc1ed5 req-d938de51-97cf-43ae-894d-7d5389bae72c service nova] Creating event network-changed:43a79878-e56a-45c7-8b88-233e7d8b4349 for instance 3d30c2bb-a513-4a88-a9e4-3cf892bda262 on hv-cinder-85200 Aug 10 13:42:59.126008 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-7eec3e09-84de-43d9-a3e0-38a2ccbc1ed5 req-d938de51-97cf-43ae-894d-7d5389bae72c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072249 Aug 10 13:42:59.126611 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 372/710] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:42:59.134436 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-c834b6c8-4fe1-4bfd-9afb-8e2a477b4ae4 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:42:59.135473 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-c834b6c8-4fe1-4bfd-9afb-8e2a477b4ae4 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 3d30c2bb-a513-4a88-a9e4-3cf892bda262] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:42:59.143769 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c834b6c8-4fe1-4bfd-9afb-8e2a477b4ae4 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:59.144435 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c834b6c8-4fe1-4bfd-9afb-8e2a477b4ae4 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:59.145035 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c834b6c8-4fe1-4bfd-9afb-8e2a477b4ae4 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:59.146053 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c834b6c8-4fe1-4bfd-9afb-8e2a477b4ae4 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:42:59.146661 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c834b6c8-4fe1-4bfd-9afb-8e2a477b4ae4 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:42:59.147232 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c834b6c8-4fe1-4bfd-9afb-8e2a477b4ae4 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:42:59.168037 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:42:59.338684 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-c834b6c8-4fe1-4bfd-9afb-8e2a477b4ae4 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:59.348876 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-c834b6c8-4fe1-4bfd-9afb-8e2a477b4ae4 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262" status: 200 len: 1364 microversion: 2.1 time: 0.220522 Aug 10 13:42:59.363401 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 373/711] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:59 2022] GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262 => generated 1364 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:42:59.364405 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-7ba92f36-9ae5-4011-85e6-be0c9c3593b8 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:42:59.375901 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-7ba92f36-9ae5-4011-85e6-be0c9c3593b8 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602" status: 200 len: 1367 microversion: 2.1 time: 0.439631 Aug 10 13:42:59.376936 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 339/712] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:42:58 2022] GET /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602 => generated 1367 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:43:00.372874 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-79db6b1c-4253-469f-baae-52f993f48ebd tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:00.373719 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-79db6b1c-4253-469f-baae-52f993f48ebd tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 3d30c2bb-a513-4a88-a9e4-3cf892bda262] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:00.382215 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-79db6b1c-4253-469f-baae-52f993f48ebd tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:00.385530 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-79db6b1c-4253-469f-baae-52f993f48ebd tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:00.386275 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-79db6b1c-4253-469f-baae-52f993f48ebd tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:00.387597 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-79db6b1c-4253-469f-baae-52f993f48ebd tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:00.391619 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-79db6b1c-4253-469f-baae-52f993f48ebd tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:00.392075 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-79db6b1c-4253-469f-baae-52f993f48ebd tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:00.406713 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-3cf46b51-8a09-4988-a48e-c85b719db2b2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:00.411653 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-3cf46b51-8a09-4988-a48e-c85b719db2b2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 59cf654d-76ac-488e-93ff-ccb46e164602] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:00.436162 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3cf46b51-8a09-4988-a48e-c85b719db2b2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:00.437189 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3cf46b51-8a09-4988-a48e-c85b719db2b2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:00.437656 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3cf46b51-8a09-4988-a48e-c85b719db2b2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:00.438361 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3cf46b51-8a09-4988-a48e-c85b719db2b2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:00.438976 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3cf46b51-8a09-4988-a48e-c85b719db2b2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:00.439297 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3cf46b51-8a09-4988-a48e-c85b719db2b2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:00.645829 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-79db6b1c-4253-469f-baae-52f993f48ebd tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:00.660223 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-79db6b1c-4253-469f-baae-52f993f48ebd tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262" status: 200 len: 1364 microversion: 2.1 time: 0.290988 Aug 10 13:43:00.660943 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 374/713] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:43:00 2022] GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262 => generated 1364 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:43:00.665609 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-5f97359d-9a64-46ae-adda-c38b5a4ce42c req-36f5dd8c-704f-454f-84df-b62108988b55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59cf654d-76ac-488e-93ff-ccb46e164602", "name": "network-vif-plugged", "status": "completed", "tag": "4a041ea6-0120-4d1d-86df-1010d3fafa8b"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:43:00.687606 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-5f97359d-9a64-46ae-adda-c38b5a4ce42c req-36f5dd8c-704f-454f-84df-b62108988b55 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:00.691169 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-5f97359d-9a64-46ae-adda-c38b5a4ce42c req-36f5dd8c-704f-454f-84df-b62108988b55 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:00.692101 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-5f97359d-9a64-46ae-adda-c38b5a4ce42c req-36f5dd8c-704f-454f-84df-b62108988b55 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:00.707596 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-5f97359d-9a64-46ae-adda-c38b5a4ce42c req-36f5dd8c-704f-454f-84df-b62108988b55 service nova] Creating event network-vif-plugged:4a041ea6-0120-4d1d-86df-1010d3fafa8b for instance 59cf654d-76ac-488e-93ff-ccb46e164602 on hv-cinder-85200 Aug 10 13:43:00.713583 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-5f97359d-9a64-46ae-adda-c38b5a4ce42c req-36f5dd8c-704f-454f-84df-b62108988b55 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050748 Aug 10 13:43:00.714648 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 375/714] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:43:00.811123 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-3cf46b51-8a09-4988-a48e-c85b719db2b2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:00.828732 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-3cf46b51-8a09-4988-a48e-c85b719db2b2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602" status: 200 len: 1367 microversion: 2.1 time: 0.433654 Aug 10 13:43:00.844353 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 340/715] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:43:00 2022] GET /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602 => generated 1367 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:43:01.682357 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-9c254499-a895-464f-85eb-9fd37d6a8c93 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:01.683820 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-9c254499-a895-464f-85eb-9fd37d6a8c93 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 3d30c2bb-a513-4a88-a9e4-3cf892bda262] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:01.690995 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9c254499-a895-464f-85eb-9fd37d6a8c93 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:01.692011 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9c254499-a895-464f-85eb-9fd37d6a8c93 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:01.692444 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9c254499-a895-464f-85eb-9fd37d6a8c93 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:01.693155 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9c254499-a895-464f-85eb-9fd37d6a8c93 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:01.694188 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9c254499-a895-464f-85eb-9fd37d6a8c93 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:01.694616 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9c254499-a895-464f-85eb-9fd37d6a8c93 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:01.854811 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-dc798f45-2796-45ed-bd5e-78b50054e6a2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:01.856586 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-dc798f45-2796-45ed-bd5e-78b50054e6a2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 59cf654d-76ac-488e-93ff-ccb46e164602] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:01.861058 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell0:SELECT=2 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:43:01.868389 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-dc798f45-2796-45ed-bd5e-78b50054e6a2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:01.869984 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-dc798f45-2796-45ed-bd5e-78b50054e6a2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:01.870631 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-dc798f45-2796-45ed-bd5e-78b50054e6a2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:01.871523 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-dc798f45-2796-45ed-bd5e-78b50054e6a2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:01.872186 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-dc798f45-2796-45ed-bd5e-78b50054e6a2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:01.872716 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-dc798f45-2796-45ed-bd5e-78b50054e6a2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:01.878926 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:43:01.976272 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-9c254499-a895-464f-85eb-9fd37d6a8c93 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:01.994662 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-9c254499-a895-464f-85eb-9fd37d6a8c93 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262" status: 200 len: 1364 microversion: 2.1 time: 0.316427 Aug 10 13:43:02.008383 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 376/716] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:43:01 2022] GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262 => generated 1364 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:43:02.083770 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-dc798f45-2796-45ed-bd5e-78b50054e6a2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:02.107687 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-dc798f45-2796-45ed-bd5e-78b50054e6a2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602" status: 200 len: 1367 microversion: 2.1 time: 0.256651 Aug 10 13:43:02.109735 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 341/717] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:43:01 2022] GET /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602 => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:43:03.016418 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-ab6573c4-3d3e-40a3-96e1-483a79d7ee79 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:03.017069 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-ab6573c4-3d3e-40a3-96e1-483a79d7ee79 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 3d30c2bb-a513-4a88-a9e4-3cf892bda262] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:03.025321 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ab6573c4-3d3e-40a3-96e1-483a79d7ee79 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:03.026392 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ab6573c4-3d3e-40a3-96e1-483a79d7ee79 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:03.026991 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ab6573c4-3d3e-40a3-96e1-483a79d7ee79 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:03.027751 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ab6573c4-3d3e-40a3-96e1-483a79d7ee79 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:03.028219 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ab6573c4-3d3e-40a3-96e1-483a79d7ee79 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:03.028676 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ab6573c4-3d3e-40a3-96e1-483a79d7ee79 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:03.129939 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-6a728b5d-a7b2-47f6-a9d5-ba401230f419 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:03.131349 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-6a728b5d-a7b2-47f6-a9d5-ba401230f419 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 59cf654d-76ac-488e-93ff-ccb46e164602] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:03.142362 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6a728b5d-a7b2-47f6-a9d5-ba401230f419 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:03.143494 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6a728b5d-a7b2-47f6-a9d5-ba401230f419 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:03.143995 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6a728b5d-a7b2-47f6-a9d5-ba401230f419 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:03.144785 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6a728b5d-a7b2-47f6-a9d5-ba401230f419 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:03.145322 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6a728b5d-a7b2-47f6-a9d5-ba401230f419 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:03.145802 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6a728b5d-a7b2-47f6-a9d5-ba401230f419 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:03.253086 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-ab6573c4-3d3e-40a3-96e1-483a79d7ee79 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:03.263773 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-ab6573c4-3d3e-40a3-96e1-483a79d7ee79 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262" status: 200 len: 1364 microversion: 2.1 time: 0.251312 Aug 10 13:43:03.264511 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 377/718] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:43:03 2022] GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262 => generated 1364 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:43:03.345741 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-6a728b5d-a7b2-47f6-a9d5-ba401230f419 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:03.356288 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-6a728b5d-a7b2-47f6-a9d5-ba401230f419 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602" status: 200 len: 1558 microversion: 2.1 time: 0.230054 Aug 10 13:43:03.369756 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 342/719] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:43:03 2022] GET /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602 => generated 1558 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:43:03.380930 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-f5502329-8de5-4e91-86e2-5995e50840da tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:03.381539 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-f5502329-8de5-4e91-86e2-5995e50840da tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 59cf654d-76ac-488e-93ff-ccb46e164602] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:03.388195 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f5502329-8de5-4e91-86e2-5995e50840da tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:03.402182 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f5502329-8de5-4e91-86e2-5995e50840da tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:03.403017 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f5502329-8de5-4e91-86e2-5995e50840da tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:03.403848 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f5502329-8de5-4e91-86e2-5995e50840da tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:03.404393 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f5502329-8de5-4e91-86e2-5995e50840da tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:03.404946 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f5502329-8de5-4e91-86e2-5995e50840da tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:03.553538 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-f5502329-8de5-4e91-86e2-5995e50840da tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.175839 Aug 10 13:43:03.555769 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 378/720] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Aug 10 13:43:03 2022] GET /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602/os-interface => generated 285 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:43:04.286054 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-7dee99de-3ed7-4203-8ff0-b0818d60bfa4 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:04.286881 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-7dee99de-3ed7-4203-8ff0-b0818d60bfa4 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 3d30c2bb-a513-4a88-a9e4-3cf892bda262] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:04.290944 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell0:SELECT=12 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:43:04.296344 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7dee99de-3ed7-4203-8ff0-b0818d60bfa4 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:04.297565 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7dee99de-3ed7-4203-8ff0-b0818d60bfa4 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:04.298101 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7dee99de-3ed7-4203-8ff0-b0818d60bfa4 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:04.298905 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7dee99de-3ed7-4203-8ff0-b0818d60bfa4 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:04.299455 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7dee99de-3ed7-4203-8ff0-b0818d60bfa4 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:04.300108 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7dee99de-3ed7-4203-8ff0-b0818d60bfa4 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:04.672610 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell0:SELECT=2 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:43:04.674534 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell0:SELECT=12 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:43:04.680151 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-2a65786f-58fb-4ecd-9a3a-8548f9a10795 req-06844e8b-1e76-4f31-a9be-c39c2b7423a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d30c2bb-a513-4a88-a9e4-3cf892bda262", "name": "network-vif-plugged", "status": "completed", "tag": "43a79878-e56a-45c7-8b88-233e7d8b4349"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:43:04.695812 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-2a65786f-58fb-4ecd-9a3a-8548f9a10795 req-06844e8b-1e76-4f31-a9be-c39c2b7423a7 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:04.696717 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-2a65786f-58fb-4ecd-9a3a-8548f9a10795 req-06844e8b-1e76-4f31-a9be-c39c2b7423a7 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:04.699001 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-2a65786f-58fb-4ecd-9a3a-8548f9a10795 req-06844e8b-1e76-4f31-a9be-c39c2b7423a7 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:04.723714 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-2a65786f-58fb-4ecd-9a3a-8548f9a10795 req-06844e8b-1e76-4f31-a9be-c39c2b7423a7 service nova] Creating event network-vif-plugged:43a79878-e56a-45c7-8b88-233e7d8b4349 for instance 3d30c2bb-a513-4a88-a9e4-3cf892bda262 on hv-cinder-85200 Aug 10 13:43:04.729668 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-2a65786f-58fb-4ecd-9a3a-8548f9a10795 req-06844e8b-1e76-4f31-a9be-c39c2b7423a7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057684 Aug 10 13:43:04.730937 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 379/721] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:43:05.069741 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-7dee99de-3ed7-4203-8ff0-b0818d60bfa4 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:05.082436 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-7dee99de-3ed7-4203-8ff0-b0818d60bfa4 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262" status: 200 len: 1364 microversion: 2.1 time: 0.802159 Aug 10 13:43:05.084938 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 343/722] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:43:04 2022] GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262 => generated 1364 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:43:05.513157 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-af04bdd3-07e7-4346-a290-dd3584676022 req-791b85a9-dbe0-49c4-b700-aa7253aad884 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59cf654d-76ac-488e-93ff-ccb46e164602", "tag": "4a041ea6-0120-4d1d-86df-1010d3fafa8b"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:43:05.528663 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-af04bdd3-07e7-4346-a290-dd3584676022 req-791b85a9-dbe0-49c4-b700-aa7253aad884 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:05.529547 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-af04bdd3-07e7-4346-a290-dd3584676022 req-791b85a9-dbe0-49c4-b700-aa7253aad884 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:05.530329 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-af04bdd3-07e7-4346-a290-dd3584676022 req-791b85a9-dbe0-49c4-b700-aa7253aad884 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:05.553941 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-af04bdd3-07e7-4346-a290-dd3584676022 req-791b85a9-dbe0-49c4-b700-aa7253aad884 service nova] Creating event network-changed:4a041ea6-0120-4d1d-86df-1010d3fafa8b for instance 59cf654d-76ac-488e-93ff-ccb46e164602 on hv-cinder-85200 Aug 10 13:43:05.560055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-af04bdd3-07e7-4346-a290-dd3584676022 req-791b85a9-dbe0-49c4-b700-aa7253aad884 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052373 Aug 10 13:43:05.561245 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 380/723] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:43:06.103986 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-f5b59559-70a6-4579-89e2-af5db4c39072 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:06.105263 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-f5b59559-70a6-4579-89e2-af5db4c39072 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 3d30c2bb-a513-4a88-a9e4-3cf892bda262] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:06.111778 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f5b59559-70a6-4579-89e2-af5db4c39072 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:06.112606 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f5b59559-70a6-4579-89e2-af5db4c39072 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:06.113333 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f5b59559-70a6-4579-89e2-af5db4c39072 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:06.114145 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f5b59559-70a6-4579-89e2-af5db4c39072 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:06.114786 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f5b59559-70a6-4579-89e2-af5db4c39072 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:06.115399 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f5b59559-70a6-4579-89e2-af5db4c39072 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:06.543329 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-f5b59559-70a6-4579-89e2-af5db4c39072 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:06.551538 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-f5b59559-70a6-4579-89e2-af5db4c39072 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262" status: 200 len: 1364 microversion: 2.1 time: 0.451441 Aug 10 13:43:06.552122 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 344/724] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:43:06 2022] GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262 => generated 1364 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:43:06.696899 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-5a3e3f3b-95ef-4513-90ec-da923f6921f5 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-832599160", "imageRef": "096d81df-12b1-4175-b914-babe0fa931c6", "flavorRef": "452", "networks": [{"uuid": "ed686501-dbb5-4b9c-8cbc-aefc13e39e97"}]}} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:43:06.761790 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.network.neutron [None req-5a3e3f3b-95ef-4513-90ec-da923f6921f5 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] validate_networks() for [('ed686501-dbb5-4b9c-8cbc-aefc13e39e97', None, None, None, None, None)] {{(pid=129522) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:43:07.198329 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.virt.hardware [None req-5a3e3f3b-95ef-4513-90ec-da923f6921f5 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Flavor limits 0:0:0 {{(pid=129522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:43:07.198758 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.virt.hardware [None req-5a3e3f3b-95ef-4513-90ec-da923f6921f5 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Image limits 0:0:0 {{(pid=129522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:43:07.199221 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.virt.hardware [None req-5a3e3f3b-95ef-4513-90ec-da923f6921f5 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Flavor pref 0:0:0 {{(pid=129522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:43:07.199624 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.virt.hardware [None req-5a3e3f3b-95ef-4513-90ec-da923f6921f5 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Image pref 0:0:0 {{(pid=129522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:43:07.200028 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.virt.hardware [None req-5a3e3f3b-95ef-4513-90ec-da923f6921f5 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:43:07.210312 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5a3e3f3b-95ef-4513-90ec-da923f6921f5 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:07.210797 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5a3e3f3b-95ef-4513-90ec-da923f6921f5 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:07.211252 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5a3e3f3b-95ef-4513-90ec-da923f6921f5 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:07.211933 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5a3e3f3b-95ef-4513-90ec-da923f6921f5 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:07.212579 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5a3e3f3b-95ef-4513-90ec-da923f6921f5 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:07.213187 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5a3e3f3b-95ef-4513-90ec-da923f6921f5 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:07.233450 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.quota [None req-5a3e3f3b-95ef-4513-90ec-da923f6921f5 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Getting quotas for project 6cafc9dd5a5341c7a823844c010eb15a. Resources: {'cores', 'ram', 'instances'} {{(pid=129522) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:43:07.237963 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.quota [None req-5a3e3f3b-95ef-4513-90ec-da923f6921f5 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Getting quotas for user ed0e66db98634e028d8706ce14488309 and project 6cafc9dd5a5341c7a823844c010eb15a. Resources: {'cores', 'ram', 'instances'} {{(pid=129522) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:43:07.256457 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-5a3e3f3b-95ef-4513-90ec-da923f6921f5 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Going to run 1 instances... {{(pid=129522) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:43:07.258870 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-5a3e3f3b-95ef-4513-90ec-da923f6921f5 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] [instance: 693851ea-5db1-4eaf-8645-224d9d18406f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='096d81df-12b1-4175-b914-babe0fa931c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129522) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:43:07.314997 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-5a3e3f3b-95ef-4513-90ec-da923f6921f5 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.623001 Aug 10 13:43:07.315654 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 381/725] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 10 13:43:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 13:43:07.329656 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-2f3403a0-b591-4e5a-a154-d33e734797ea tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:07.330431 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-2f3403a0-b591-4e5a-a154-d33e734797ea tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] [instance: 693851ea-5db1-4eaf-8645-224d9d18406f] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:07.572664 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-18813ad4-4f3d-47c1-b429-971182431b35 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:07.573293 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-18813ad4-4f3d-47c1-b429-971182431b35 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 3d30c2bb-a513-4a88-a9e4-3cf892bda262] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:07.589880 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-18813ad4-4f3d-47c1-b429-971182431b35 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:07.591863 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-18813ad4-4f3d-47c1-b429-971182431b35 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:07.594167 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-18813ad4-4f3d-47c1-b429-971182431b35 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:07.595740 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-18813ad4-4f3d-47c1-b429-971182431b35 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:07.597187 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-18813ad4-4f3d-47c1-b429-971182431b35 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:07.598487 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-18813ad4-4f3d-47c1-b429-971182431b35 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:07.703375 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-2f3403a0-b591-4e5a-a154-d33e734797ea tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0e66db98634e028d8706ce14488309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafc9dd5a5341c7a823844c010eb15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:07.717072 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-2f3403a0-b591-4e5a-a154-d33e734797ea tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] 10.222.0.52 "GET /compute/v2.1/servers/693851ea-5db1-4eaf-8645-224d9d18406f" status: 200 len: 1213 microversion: 2.1 time: 0.392965 Aug 10 13:43:07.719008 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 345/726] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:43:07 2022] GET /compute/v2.1/servers/693851ea-5db1-4eaf-8645-224d9d18406f => generated 1213 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:43:07.830525 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-18813ad4-4f3d-47c1-b429-971182431b35 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:07.840789 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-18813ad4-4f3d-47c1-b429-971182431b35 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262" status: 200 len: 1550 microversion: 2.1 time: 0.271536 Aug 10 13:43:07.843186 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 382/727] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:43:07 2022] GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262 => generated 1550 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:43:07.882967 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-43be8547-c979-469a-91ae-bda4e9994090 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:07.884727 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-43be8547-c979-469a-91ae-bda4e9994090 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 3d30c2bb-a513-4a88-a9e4-3cf892bda262] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:07.894487 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-43be8547-c979-469a-91ae-bda4e9994090 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:07.895319 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-43be8547-c979-469a-91ae-bda4e9994090 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:07.895956 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-43be8547-c979-469a-91ae-bda4e9994090 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:07.896923 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-43be8547-c979-469a-91ae-bda4e9994090 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:07.897740 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-43be8547-c979-469a-91ae-bda4e9994090 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:07.898395 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-43be8547-c979-469a-91ae-bda4e9994090 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:08.016032 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-9519dc0f-15dc-463d-b4f0-335d2ab41bbd tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:08.016904 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-9519dc0f-15dc-463d-b4f0-335d2ab41bbd tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:08.026283 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9519dc0f-15dc-463d-b4f0-335d2ab41bbd tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:08.026936 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9519dc0f-15dc-463d-b4f0-335d2ab41bbd tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:08.027448 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9519dc0f-15dc-463d-b4f0-335d2ab41bbd tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:08.028242 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9519dc0f-15dc-463d-b4f0-335d2ab41bbd tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:08.029136 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9519dc0f-15dc-463d-b4f0-335d2ab41bbd tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:08.029858 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9519dc0f-15dc-463d-b4f0-335d2ab41bbd tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:08.068836 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-9519dc0f-15dc-463d-b4f0-335d2ab41bbd tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f/ips" status: 200 len: 150 microversion: 2.20 time: 0.296390 Aug 10 13:43:08.069912 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 346/728] 10.222.0.52 () {60 vars in 1289 bytes} [Wed Aug 10 13:43:07 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f/ips => generated 150 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 13:43:08.088147 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-43be8547-c979-469a-91ae-bda4e9994090 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.215479 Aug 10 13:43:08.089027 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 383/729] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Aug 10 13:43:07 2022] GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262/os-interface => generated 285 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:43:08.742251 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-6c71cf77-f482-4fb0-bac3-a76e499caad3 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:08.743949 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-6c71cf77-f482-4fb0-bac3-a76e499caad3 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] [instance: 693851ea-5db1-4eaf-8645-224d9d18406f] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:08.768997 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6c71cf77-f482-4fb0-bac3-a76e499caad3 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:08.769643 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6c71cf77-f482-4fb0-bac3-a76e499caad3 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:08.770077 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6c71cf77-f482-4fb0-bac3-a76e499caad3 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:08.770788 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6c71cf77-f482-4fb0-bac3-a76e499caad3 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:08.771239 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6c71cf77-f482-4fb0-bac3-a76e499caad3 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:08.771756 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6c71cf77-f482-4fb0-bac3-a76e499caad3 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:08.977782 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-6c71cf77-f482-4fb0-bac3-a76e499caad3 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0e66db98634e028d8706ce14488309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafc9dd5a5341c7a823844c010eb15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:08.984808 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-6c71cf77-f482-4fb0-bac3-a76e499caad3 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] 10.222.0.52 "GET /compute/v2.1/servers/693851ea-5db1-4eaf-8645-224d9d18406f" status: 200 len: 1271 microversion: 2.1 time: 0.248368 Aug 10 13:43:08.985406 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 347/730] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:43:08 2022] GET /compute/v2.1/servers/693851ea-5db1-4eaf-8645-224d9d18406f => generated 1271 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:43:10.007616 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-b7cd81ff-4224-4dbf-aa2e-5771b3fcd51a tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:10.008395 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-b7cd81ff-4224-4dbf-aa2e-5771b3fcd51a tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] [instance: 693851ea-5db1-4eaf-8645-224d9d18406f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:10.021278 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b7cd81ff-4224-4dbf-aa2e-5771b3fcd51a tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:10.025503 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b7cd81ff-4224-4dbf-aa2e-5771b3fcd51a tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:10.025679 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b7cd81ff-4224-4dbf-aa2e-5771b3fcd51a tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:10.026837 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b7cd81ff-4224-4dbf-aa2e-5771b3fcd51a tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:10.027516 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b7cd81ff-4224-4dbf-aa2e-5771b3fcd51a tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:10.028188 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b7cd81ff-4224-4dbf-aa2e-5771b3fcd51a tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:10.047910 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-aef5af77-4bd0-4ae0-bc27-5a4644884974 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:43:10.049212 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-aef5af77-4bd0-4ae0-bc27-5a4644884974 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:10.058584 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-aef5af77-4bd0-4ae0-bc27-5a4644884974 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:10.059515 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-aef5af77-4bd0-4ae0-bc27-5a4644884974 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:10.060115 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-aef5af77-4bd0-4ae0-bc27-5a4644884974 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:10.061565 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-aef5af77-4bd0-4ae0-bc27-5a4644884974 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:10.062205 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-aef5af77-4bd0-4ae0-bc27-5a4644884974 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:10.062806 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-aef5af77-4bd0-4ae0-bc27-5a4644884974 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:10.103713 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.objects.instance [None req-aef5af77-4bd0-4ae0-bc27-5a4644884974 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lazy-loading 'flavor' on Instance uuid 3aa512f7-4b23-46bf-aa72-a3f72f2e122f {{(pid=129523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:43:10.120429 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-b7cd81ff-4224-4dbf-aa2e-5771b3fcd51a tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0e66db98634e028d8706ce14488309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafc9dd5a5341c7a823844c010eb15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:10.129111 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-b7cd81ff-4224-4dbf-aa2e-5771b3fcd51a tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] 10.222.0.52 "GET /compute/v2.1/servers/693851ea-5db1-4eaf-8645-224d9d18406f" status: 200 len: 1271 microversion: 2.1 time: 0.125977 Aug 10 13:43:10.130672 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 384/731] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:43:10 2022] GET /compute/v2.1/servers/693851ea-5db1-4eaf-8645-224d9d18406f => generated 1271 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:43:10.382701 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-aef5af77-4bd0-4ae0-bc27-5a4644884974 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "POST /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f/action" status: 202 len: 0 microversion: 2.20 time: 0.341934 Aug 10 13:43:10.384382 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 348/732] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Aug 10 13:43:10 2022] POST /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:43:10.414517 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-07490958-ba9d-43be-96cf-01d428d3c5c7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:10.415727 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-07490958-ba9d-43be-96cf-01d428d3c5c7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:10.417126 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-e6ea8c81-ba61-4c4e-bc15-9e20c7309c8c req-86854965-18ac-4731-995c-e1867195c4e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d30c2bb-a513-4a88-a9e4-3cf892bda262", "tag": "43a79878-e56a-45c7-8b88-233e7d8b4349"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:43:10.430119 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-e6ea8c81-ba61-4c4e-bc15-9e20c7309c8c req-86854965-18ac-4731-995c-e1867195c4e8 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:10.431025 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-e6ea8c81-ba61-4c4e-bc15-9e20c7309c8c req-86854965-18ac-4731-995c-e1867195c4e8 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:10.431719 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-e6ea8c81-ba61-4c4e-bc15-9e20c7309c8c req-86854965-18ac-4731-995c-e1867195c4e8 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:10.455008 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-07490958-ba9d-43be-96cf-01d428d3c5c7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:10.457473 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-07490958-ba9d-43be-96cf-01d428d3c5c7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:10.459142 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-07490958-ba9d-43be-96cf-01d428d3c5c7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:10.461861 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-07490958-ba9d-43be-96cf-01d428d3c5c7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:10.467244 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-07490958-ba9d-43be-96cf-01d428d3c5c7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:10.468735 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-07490958-ba9d-43be-96cf-01d428d3c5c7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:10.473022 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-e6ea8c81-ba61-4c4e-bc15-9e20c7309c8c req-86854965-18ac-4731-995c-e1867195c4e8 service nova] Creating event network-changed:43a79878-e56a-45c7-8b88-233e7d8b4349 for instance 3d30c2bb-a513-4a88-a9e4-3cf892bda262 on hv-cinder-85200 Aug 10 13:43:10.482001 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-e6ea8c81-ba61-4c4e-bc15-9e20c7309c8c req-86854965-18ac-4731-995c-e1867195c4e8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070462 Aug 10 13:43:10.483388 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 349/733] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:43:10.781522 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-07490958-ba9d-43be-96cf-01d428d3c5c7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:10.800724 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-07490958-ba9d-43be-96cf-01d428d3c5c7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:10.802320 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-07490958-ba9d-43be-96cf-01d428d3c5c7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:10.804130 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-07490958-ba9d-43be-96cf-01d428d3c5c7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1722 microversion: 2.20 time: 0.411602 Aug 10 13:43:10.820380 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 385/734] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:10 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1722 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:43:11.154592 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-d38f950b-fed6-40c3-b4c6-b9c601e18dd5 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:11.156674 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-d38f950b-fed6-40c3-b4c6-b9c601e18dd5 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] [instance: 693851ea-5db1-4eaf-8645-224d9d18406f] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:11.163333 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d38f950b-fed6-40c3-b4c6-b9c601e18dd5 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:11.164141 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d38f950b-fed6-40c3-b4c6-b9c601e18dd5 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:11.164790 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d38f950b-fed6-40c3-b4c6-b9c601e18dd5 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:11.165739 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d38f950b-fed6-40c3-b4c6-b9c601e18dd5 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:11.166467 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d38f950b-fed6-40c3-b4c6-b9c601e18dd5 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:11.167135 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d38f950b-fed6-40c3-b4c6-b9c601e18dd5 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:11.528825 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-d38f950b-fed6-40c3-b4c6-b9c601e18dd5 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0e66db98634e028d8706ce14488309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafc9dd5a5341c7a823844c010eb15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:11.543841 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-d38f950b-fed6-40c3-b4c6-b9c601e18dd5 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] 10.222.0.52 "GET /compute/v2.1/servers/693851ea-5db1-4eaf-8645-224d9d18406f" status: 200 len: 1313 microversion: 2.1 time: 0.395961 Aug 10 13:43:11.545004 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 350/735] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:43:11 2022] GET /compute/v2.1/servers/693851ea-5db1-4eaf-8645-224d9d18406f => generated 1313 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:43:11.837128 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-3ee9e946-1bf8-4ca8-8daa-aea37c651e45 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:11.842242 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-3ee9e946-1bf8-4ca8-8daa-aea37c651e45 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:11.873014 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3ee9e946-1bf8-4ca8-8daa-aea37c651e45 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:11.875732 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3ee9e946-1bf8-4ca8-8daa-aea37c651e45 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:11.876177 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3ee9e946-1bf8-4ca8-8daa-aea37c651e45 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:11.878097 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3ee9e946-1bf8-4ca8-8daa-aea37c651e45 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:11.878564 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3ee9e946-1bf8-4ca8-8daa-aea37c651e45 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:11.878973 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3ee9e946-1bf8-4ca8-8daa-aea37c651e45 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:12.049031 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-3ee9e946-1bf8-4ca8-8daa-aea37c651e45 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:12.058669 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-3ee9e946-1bf8-4ca8-8daa-aea37c651e45 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:12.060287 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-3ee9e946-1bf8-4ca8-8daa-aea37c651e45 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:12.061980 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-3ee9e946-1bf8-4ca8-8daa-aea37c651e45 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1722 microversion: 2.20 time: 0.237439 Aug 10 13:43:12.062562 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 386/736] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:11 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:43:12.559807 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-9e4234a7-c6df-4c0f-8703-d345e721eb97 req-5e423c8b-0431-4d7b-9c15-9db0a9bb4e73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "693851ea-5db1-4eaf-8645-224d9d18406f", "tag": "046d544f-5acc-44f6-90d6-4a8780ea539f"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:43:12.566221 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-94e0be3d-8585-44ad-8ca6-4bd579d8eeed tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:12.566922 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-94e0be3d-8585-44ad-8ca6-4bd579d8eeed tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] [instance: 693851ea-5db1-4eaf-8645-224d9d18406f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:12.570700 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-9e4234a7-c6df-4c0f-8703-d345e721eb97 req-5e423c8b-0431-4d7b-9c15-9db0a9bb4e73 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:12.571214 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-9e4234a7-c6df-4c0f-8703-d345e721eb97 req-5e423c8b-0431-4d7b-9c15-9db0a9bb4e73 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:12.571641 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-9e4234a7-c6df-4c0f-8703-d345e721eb97 req-5e423c8b-0431-4d7b-9c15-9db0a9bb4e73 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:12.578197 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-94e0be3d-8585-44ad-8ca6-4bd579d8eeed tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:12.578676 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-94e0be3d-8585-44ad-8ca6-4bd579d8eeed tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:12.579132 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-94e0be3d-8585-44ad-8ca6-4bd579d8eeed tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:12.579824 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-94e0be3d-8585-44ad-8ca6-4bd579d8eeed tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:12.580267 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-94e0be3d-8585-44ad-8ca6-4bd579d8eeed tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:12.580819 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-94e0be3d-8585-44ad-8ca6-4bd579d8eeed tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:12.582653 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-9e4234a7-c6df-4c0f-8703-d345e721eb97 req-5e423c8b-0431-4d7b-9c15-9db0a9bb4e73 service nova] Creating event network-changed:046d544f-5acc-44f6-90d6-4a8780ea539f for instance 693851ea-5db1-4eaf-8645-224d9d18406f on hv-cinder-85200 Aug 10 13:43:12.587652 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-9e4234a7-c6df-4c0f-8703-d345e721eb97 req-5e423c8b-0431-4d7b-9c15-9db0a9bb4e73 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031615 Aug 10 13:43:12.588241 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 351/737] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:43:12.714874 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-94e0be3d-8585-44ad-8ca6-4bd579d8eeed tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0e66db98634e028d8706ce14488309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafc9dd5a5341c7a823844c010eb15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:12.722443 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-94e0be3d-8585-44ad-8ca6-4bd579d8eeed tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] 10.222.0.52 "GET /compute/v2.1/servers/693851ea-5db1-4eaf-8645-224d9d18406f" status: 200 len: 1313 microversion: 2.1 time: 0.161096 Aug 10 13:43:12.723010 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 387/738] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:43:12 2022] GET /compute/v2.1/servers/693851ea-5db1-4eaf-8645-224d9d18406f => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:43:13.085693 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-953d945a-220c-43c3-bb54-b11fae40edae tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:13.086391 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-953d945a-220c-43c3-bb54-b11fae40edae tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:13.094320 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-953d945a-220c-43c3-bb54-b11fae40edae tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:13.094832 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-953d945a-220c-43c3-bb54-b11fae40edae tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:13.095946 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-953d945a-220c-43c3-bb54-b11fae40edae tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:13.095946 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-953d945a-220c-43c3-bb54-b11fae40edae tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:13.096419 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-953d945a-220c-43c3-bb54-b11fae40edae tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:13.096848 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-953d945a-220c-43c3-bb54-b11fae40edae tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:13.239576 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-953d945a-220c-43c3-bb54-b11fae40edae tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:13.248081 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-953d945a-220c-43c3-bb54-b11fae40edae tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:13.249674 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-953d945a-220c-43c3-bb54-b11fae40edae tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:13.250889 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-953d945a-220c-43c3-bb54-b11fae40edae tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1722 microversion: 2.20 time: 0.169452 Aug 10 13:43:13.251445 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 352/739] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:13 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:43:13.744197 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-10d92cd3-423f-45b6-a856-a3c5758eb88f tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:13.744822 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-10d92cd3-423f-45b6-a856-a3c5758eb88f tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] [instance: 693851ea-5db1-4eaf-8645-224d9d18406f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:13.751228 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-10d92cd3-423f-45b6-a856-a3c5758eb88f tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:13.751714 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-10d92cd3-423f-45b6-a856-a3c5758eb88f tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:13.752144 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-10d92cd3-423f-45b6-a856-a3c5758eb88f tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:13.752838 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-10d92cd3-423f-45b6-a856-a3c5758eb88f tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:13.753319 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-10d92cd3-423f-45b6-a856-a3c5758eb88f tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:13.753787 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-10d92cd3-423f-45b6-a856-a3c5758eb88f tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:13.895747 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-10d92cd3-423f-45b6-a856-a3c5758eb88f tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0e66db98634e028d8706ce14488309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafc9dd5a5341c7a823844c010eb15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:13.904023 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-10d92cd3-423f-45b6-a856-a3c5758eb88f tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] 10.222.0.52 "GET /compute/v2.1/servers/693851ea-5db1-4eaf-8645-224d9d18406f" status: 200 len: 1313 microversion: 2.1 time: 0.163700 Aug 10 13:43:13.905104 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 388/740] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:43:13 2022] GET /compute/v2.1/servers/693851ea-5db1-4eaf-8645-224d9d18406f => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:43:14.273321 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-f30b5917-d674-4bfe-abfe-8d0e3084443e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:14.273946 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-f30b5917-d674-4bfe-abfe-8d0e3084443e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:14.281111 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f30b5917-d674-4bfe-abfe-8d0e3084443e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:14.281636 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f30b5917-d674-4bfe-abfe-8d0e3084443e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:14.282066 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f30b5917-d674-4bfe-abfe-8d0e3084443e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:14.282787 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f30b5917-d674-4bfe-abfe-8d0e3084443e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:14.283232 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f30b5917-d674-4bfe-abfe-8d0e3084443e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:14.283648 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f30b5917-d674-4bfe-abfe-8d0e3084443e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:14.417882 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-f30b5917-d674-4bfe-abfe-8d0e3084443e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:14.427260 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-f30b5917-d674-4bfe-abfe-8d0e3084443e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:14.428619 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-f30b5917-d674-4bfe-abfe-8d0e3084443e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:14.429865 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-f30b5917-d674-4bfe-abfe-8d0e3084443e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1722 microversion: 2.20 time: 0.160559 Aug 10 13:43:14.430431 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 353/741] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:14 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:43:14.924945 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-5e9c6484-1a27-4cc5-a2de-3ff1363d81f8 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:14.925775 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-5e9c6484-1a27-4cc5-a2de-3ff1363d81f8 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] [instance: 693851ea-5db1-4eaf-8645-224d9d18406f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:14.932150 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5e9c6484-1a27-4cc5-a2de-3ff1363d81f8 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:14.932608 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5e9c6484-1a27-4cc5-a2de-3ff1363d81f8 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:14.933037 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5e9c6484-1a27-4cc5-a2de-3ff1363d81f8 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:14.933747 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5e9c6484-1a27-4cc5-a2de-3ff1363d81f8 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:14.934193 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5e9c6484-1a27-4cc5-a2de-3ff1363d81f8 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:14.934604 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5e9c6484-1a27-4cc5-a2de-3ff1363d81f8 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:15.071898 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-5e9c6484-1a27-4cc5-a2de-3ff1363d81f8 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0e66db98634e028d8706ce14488309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafc9dd5a5341c7a823844c010eb15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:15.079808 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-5e9c6484-1a27-4cc5-a2de-3ff1363d81f8 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] 10.222.0.52 "GET /compute/v2.1/servers/693851ea-5db1-4eaf-8645-224d9d18406f" status: 200 len: 1313 microversion: 2.1 time: 0.158684 Aug 10 13:43:15.080370 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 389/742] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:43:14 2022] GET /compute/v2.1/servers/693851ea-5db1-4eaf-8645-224d9d18406f => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:43:15.454261 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-bf612ba0-948b-499e-8eac-5bc1eb0be832 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:15.454876 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-bf612ba0-948b-499e-8eac-5bc1eb0be832 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:15.461791 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bf612ba0-948b-499e-8eac-5bc1eb0be832 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:15.462268 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bf612ba0-948b-499e-8eac-5bc1eb0be832 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:15.462712 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bf612ba0-948b-499e-8eac-5bc1eb0be832 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:15.463407 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bf612ba0-948b-499e-8eac-5bc1eb0be832 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:15.463860 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bf612ba0-948b-499e-8eac-5bc1eb0be832 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:15.464282 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bf612ba0-948b-499e-8eac-5bc1eb0be832 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:15.598033 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-bf612ba0-948b-499e-8eac-5bc1eb0be832 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:15.605928 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-bf612ba0-948b-499e-8eac-5bc1eb0be832 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:15.607430 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-bf612ba0-948b-499e-8eac-5bc1eb0be832 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:15.609080 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-bf612ba0-948b-499e-8eac-5bc1eb0be832 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1722 microversion: 2.20 time: 0.159351 Aug 10 13:43:15.609741 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 354/743] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:15 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:43:16.100243 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-9494a0fd-6431-4912-940b-e83948004a6a tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:16.100922 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-9494a0fd-6431-4912-940b-e83948004a6a tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] [instance: 693851ea-5db1-4eaf-8645-224d9d18406f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:16.108446 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9494a0fd-6431-4912-940b-e83948004a6a tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:16.108899 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9494a0fd-6431-4912-940b-e83948004a6a tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:16.109358 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9494a0fd-6431-4912-940b-e83948004a6a tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:16.110172 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9494a0fd-6431-4912-940b-e83948004a6a tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:16.110518 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9494a0fd-6431-4912-940b-e83948004a6a tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:16.110945 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9494a0fd-6431-4912-940b-e83948004a6a tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:16.259949 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-9494a0fd-6431-4912-940b-e83948004a6a tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0e66db98634e028d8706ce14488309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafc9dd5a5341c7a823844c010eb15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:16.268606 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-9494a0fd-6431-4912-940b-e83948004a6a tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] 10.222.0.52 "GET /compute/v2.1/servers/693851ea-5db1-4eaf-8645-224d9d18406f" status: 200 len: 1313 microversion: 2.1 time: 0.172283 Aug 10 13:43:16.269184 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 390/744] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:43:16 2022] GET /compute/v2.1/servers/693851ea-5db1-4eaf-8645-224d9d18406f => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:43:16.597144 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-adb06ed9-9a43-4d60-98ec-ab0afd0a46c9 req-7c96e4ae-0daf-44a7-86fa-c680afb7f16b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "693851ea-5db1-4eaf-8645-224d9d18406f", "name": "network-vif-plugged", "status": "completed", "tag": "046d544f-5acc-44f6-90d6-4a8780ea539f"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:43:16.607632 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-adb06ed9-9a43-4d60-98ec-ab0afd0a46c9 req-7c96e4ae-0daf-44a7-86fa-c680afb7f16b service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:16.608125 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-adb06ed9-9a43-4d60-98ec-ab0afd0a46c9 req-7c96e4ae-0daf-44a7-86fa-c680afb7f16b service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:16.608616 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-adb06ed9-9a43-4d60-98ec-ab0afd0a46c9 req-7c96e4ae-0daf-44a7-86fa-c680afb7f16b service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:16.624061 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-adb06ed9-9a43-4d60-98ec-ab0afd0a46c9 req-7c96e4ae-0daf-44a7-86fa-c680afb7f16b service nova] Creating event network-vif-plugged:046d544f-5acc-44f6-90d6-4a8780ea539f for instance 693851ea-5db1-4eaf-8645-224d9d18406f on hv-cinder-85200 Aug 10 13:43:16.629081 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-adb06ed9-9a43-4d60-98ec-ab0afd0a46c9 req-7c96e4ae-0daf-44a7-86fa-c680afb7f16b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036568 Aug 10 13:43:16.629980 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 355/745] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:43:16.631957 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-b76a706a-61db-4d79-bd90-b1822299896f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:16.632560 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-b76a706a-61db-4d79-bd90-b1822299896f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:16.639300 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b76a706a-61db-4d79-bd90-b1822299896f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:16.639790 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b76a706a-61db-4d79-bd90-b1822299896f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:16.640215 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b76a706a-61db-4d79-bd90-b1822299896f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:16.640934 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b76a706a-61db-4d79-bd90-b1822299896f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:16.641418 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b76a706a-61db-4d79-bd90-b1822299896f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:16.641833 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b76a706a-61db-4d79-bd90-b1822299896f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:16.806239 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-b76a706a-61db-4d79-bd90-b1822299896f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:16.815919 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-b76a706a-61db-4d79-bd90-b1822299896f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:16.818551 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-b76a706a-61db-4d79-bd90-b1822299896f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:16.820409 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-b76a706a-61db-4d79-bd90-b1822299896f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1722 microversion: 2.20 time: 0.192219 Aug 10 13:43:16.821362 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 391/746] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:16 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:43:17.290002 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-c41cc861-f549-41f1-af85-c797b3808e60 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:17.290701 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-c41cc861-f549-41f1-af85-c797b3808e60 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] [instance: 693851ea-5db1-4eaf-8645-224d9d18406f] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:17.297703 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c41cc861-f549-41f1-af85-c797b3808e60 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:17.298229 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c41cc861-f549-41f1-af85-c797b3808e60 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:17.298669 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c41cc861-f549-41f1-af85-c797b3808e60 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:17.299397 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c41cc861-f549-41f1-af85-c797b3808e60 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:17.299850 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c41cc861-f549-41f1-af85-c797b3808e60 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:17.300282 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c41cc861-f549-41f1-af85-c797b3808e60 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:17.435465 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-c41cc861-f549-41f1-af85-c797b3808e60 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0e66db98634e028d8706ce14488309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafc9dd5a5341c7a823844c010eb15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:17.443827 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-c41cc861-f549-41f1-af85-c797b3808e60 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] 10.222.0.52 "GET /compute/v2.1/servers/693851ea-5db1-4eaf-8645-224d9d18406f" status: 200 len: 1313 microversion: 2.1 time: 0.158066 Aug 10 13:43:17.444403 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 356/747] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:43:17 2022] GET /compute/v2.1/servers/693851ea-5db1-4eaf-8645-224d9d18406f => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:43:17.845057 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-e95cf8fb-b36f-4625-9e81-4bbc374eef9e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:17.845695 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-e95cf8fb-b36f-4625-9e81-4bbc374eef9e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:17.849646 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell0:SELECT=2 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:43:17.850527 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell0:SELECT=6 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:43:17.857309 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e95cf8fb-b36f-4625-9e81-4bbc374eef9e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:17.857922 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e95cf8fb-b36f-4625-9e81-4bbc374eef9e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:17.858349 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e95cf8fb-b36f-4625-9e81-4bbc374eef9e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:17.859046 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e95cf8fb-b36f-4625-9e81-4bbc374eef9e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:17.859492 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e95cf8fb-b36f-4625-9e81-4bbc374eef9e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:17.859909 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e95cf8fb-b36f-4625-9e81-4bbc374eef9e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:17.995103 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-e95cf8fb-b36f-4625-9e81-4bbc374eef9e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:18.005745 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-e95cf8fb-b36f-4625-9e81-4bbc374eef9e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:18.008242 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-e95cf8fb-b36f-4625-9e81-4bbc374eef9e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:18.010306 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-e95cf8fb-b36f-4625-9e81-4bbc374eef9e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1722 microversion: 2.20 time: 0.169874 Aug 10 13:43:18.011291 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 392/748] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:17 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:43:18.467502 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-351a7d5f-e1dc-4916-ab16-58c47ee46991 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:18.468517 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-351a7d5f-e1dc-4916-ab16-58c47ee46991 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] [instance: 693851ea-5db1-4eaf-8645-224d9d18406f] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:18.472313 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell0:SELECT=2 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:43:18.473525 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:43:18.481913 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-351a7d5f-e1dc-4916-ab16-58c47ee46991 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:18.482446 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-351a7d5f-e1dc-4916-ab16-58c47ee46991 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:18.482901 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-351a7d5f-e1dc-4916-ab16-58c47ee46991 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:18.483644 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-351a7d5f-e1dc-4916-ab16-58c47ee46991 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:18.484121 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-351a7d5f-e1dc-4916-ab16-58c47ee46991 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:18.484550 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-351a7d5f-e1dc-4916-ab16-58c47ee46991 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:18.622835 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-351a7d5f-e1dc-4916-ab16-58c47ee46991 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0e66db98634e028d8706ce14488309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafc9dd5a5341c7a823844c010eb15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:18.631377 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-351a7d5f-e1dc-4916-ab16-58c47ee46991 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] 10.222.0.52 "GET /compute/v2.1/servers/693851ea-5db1-4eaf-8645-224d9d18406f" status: 200 len: 1313 microversion: 2.1 time: 0.170131 Aug 10 13:43:18.631975 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 357/749] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:43:18 2022] GET /compute/v2.1/servers/693851ea-5db1-4eaf-8645-224d9d18406f => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:43:19.034167 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-471496dd-faac-427c-8ade-6c1814bdae17 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:19.034775 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-471496dd-faac-427c-8ade-6c1814bdae17 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:19.041315 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-471496dd-faac-427c-8ade-6c1814bdae17 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:19.041793 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-471496dd-faac-427c-8ade-6c1814bdae17 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:19.042231 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-471496dd-faac-427c-8ade-6c1814bdae17 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:19.042923 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-471496dd-faac-427c-8ade-6c1814bdae17 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:19.043374 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-471496dd-faac-427c-8ade-6c1814bdae17 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:19.043787 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-471496dd-faac-427c-8ade-6c1814bdae17 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:19.059583 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell1:SELECT=100 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:43:19.181970 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-471496dd-faac-427c-8ade-6c1814bdae17 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:19.191094 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-471496dd-faac-427c-8ade-6c1814bdae17 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:19.192682 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-471496dd-faac-427c-8ade-6c1814bdae17 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:19.194127 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-471496dd-faac-427c-8ade-6c1814bdae17 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1722 microversion: 2.20 time: 0.164576 Aug 10 13:43:19.194720 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 393/750] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:19 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:43:19.653207 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-5fd137d6-9ac6-4d10-b9c5-c4fa8606f3ee tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:19.653952 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-5fd137d6-9ac6-4d10-b9c5-c4fa8606f3ee tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] [instance: 693851ea-5db1-4eaf-8645-224d9d18406f] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:19.661374 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5fd137d6-9ac6-4d10-b9c5-c4fa8606f3ee tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:19.661867 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5fd137d6-9ac6-4d10-b9c5-c4fa8606f3ee tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:19.662328 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5fd137d6-9ac6-4d10-b9c5-c4fa8606f3ee tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:19.663030 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5fd137d6-9ac6-4d10-b9c5-c4fa8606f3ee tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:19.663514 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5fd137d6-9ac6-4d10-b9c5-c4fa8606f3ee tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:19.663938 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5fd137d6-9ac6-4d10-b9c5-c4fa8606f3ee tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:19.799007 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-5fd137d6-9ac6-4d10-b9c5-c4fa8606f3ee tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0e66db98634e028d8706ce14488309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafc9dd5a5341c7a823844c010eb15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:19.807574 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-5fd137d6-9ac6-4d10-b9c5-c4fa8606f3ee tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] 10.222.0.52 "GET /compute/v2.1/servers/693851ea-5db1-4eaf-8645-224d9d18406f" status: 200 len: 1497 microversion: 2.1 time: 0.159276 Aug 10 13:43:19.808154 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 358/751] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:43:19 2022] GET /compute/v2.1/servers/693851ea-5db1-4eaf-8645-224d9d18406f => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:43:20.218370 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-9da4e3da-7ffc-4a53-ab54-5ae8034f5f59 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:20.219046 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-9da4e3da-7ffc-4a53-ab54-5ae8034f5f59 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:20.225563 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9da4e3da-7ffc-4a53-ab54-5ae8034f5f59 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:20.226052 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9da4e3da-7ffc-4a53-ab54-5ae8034f5f59 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:20.226486 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9da4e3da-7ffc-4a53-ab54-5ae8034f5f59 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:20.227179 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9da4e3da-7ffc-4a53-ab54-5ae8034f5f59 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:20.227853 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9da4e3da-7ffc-4a53-ab54-5ae8034f5f59 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:20.228286 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9da4e3da-7ffc-4a53-ab54-5ae8034f5f59 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:20.259530 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-241c3922-5e76-4d29-8e4a-46e519cc4645 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:20.259946 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-241c3922-5e76-4d29-8e4a-46e519cc4645 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] [instance: 693851ea-5db1-4eaf-8645-224d9d18406f] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:20.267017 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-241c3922-5e76-4d29-8e4a-46e519cc4645 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:20.267514 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-241c3922-5e76-4d29-8e4a-46e519cc4645 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:20.267954 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-241c3922-5e76-4d29-8e4a-46e519cc4645 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:20.268658 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-241c3922-5e76-4d29-8e4a-46e519cc4645 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:20.269115 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-241c3922-5e76-4d29-8e4a-46e519cc4645 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:20.269575 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-241c3922-5e76-4d29-8e4a-46e519cc4645 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:20.273953 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:43:20.299434 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-241c3922-5e76-4d29-8e4a-46e519cc4645 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] [instance: 693851ea-5db1-4eaf-8645-224d9d18406f] Going to try to terminate instance {{(pid=129523) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:43:20.379124 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-9da4e3da-7ffc-4a53-ab54-5ae8034f5f59 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:20.389989 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-241c3922-5e76-4d29-8e4a-46e519cc4645 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] 10.222.0.52 "DELETE /compute/v2.1/servers/693851ea-5db1-4eaf-8645-224d9d18406f" status: 204 len: 0 microversion: 2.1 time: 0.133168 Aug 10 13:43:20.391109 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 359/752] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 10 13:43:20 2022] DELETE /compute/v2.1/servers/693851ea-5db1-4eaf-8645-224d9d18406f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 13:43:20.396413 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-9da4e3da-7ffc-4a53-ab54-5ae8034f5f59 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:20.398307 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-9da4e3da-7ffc-4a53-ab54-5ae8034f5f59 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:20.399562 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-9da4e3da-7ffc-4a53-ab54-5ae8034f5f59 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1722 microversion: 2.20 time: 0.185091 Aug 10 13:43:20.400135 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 394/753] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:20 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:43:20.407951 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-58ed0453-e359-4dd1-b39b-6c4e4a0e07cc tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:20.408692 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-58ed0453-e359-4dd1-b39b-6c4e4a0e07cc tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] [instance: 693851ea-5db1-4eaf-8645-224d9d18406f] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:20.415371 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-58ed0453-e359-4dd1-b39b-6c4e4a0e07cc tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:20.415854 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-58ed0453-e359-4dd1-b39b-6c4e4a0e07cc tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:20.416280 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-58ed0453-e359-4dd1-b39b-6c4e4a0e07cc tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:20.416981 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-58ed0453-e359-4dd1-b39b-6c4e4a0e07cc tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:20.418023 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-58ed0453-e359-4dd1-b39b-6c4e4a0e07cc tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:20.418023 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-58ed0453-e359-4dd1-b39b-6c4e4a0e07cc tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:20.564472 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-58ed0453-e359-4dd1-b39b-6c4e4a0e07cc tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0e66db98634e028d8706ce14488309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafc9dd5a5341c7a823844c010eb15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:20.577827 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-58ed0453-e359-4dd1-b39b-6c4e4a0e07cc tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] 10.222.0.52 "GET /compute/v2.1/servers/693851ea-5db1-4eaf-8645-224d9d18406f" status: 200 len: 1503 microversion: 2.1 time: 0.181076 Aug 10 13:43:20.578834 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 360/754] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:43:20 2022] GET /compute/v2.1/servers/693851ea-5db1-4eaf-8645-224d9d18406f => generated 1503 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:43:21.426796 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-7989344d-4af3-4be9-bfe5-79635119a59f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:21.427407 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-7989344d-4af3-4be9-bfe5-79635119a59f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:21.434422 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7989344d-4af3-4be9-bfe5-79635119a59f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:21.434904 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7989344d-4af3-4be9-bfe5-79635119a59f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:21.435330 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7989344d-4af3-4be9-bfe5-79635119a59f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:21.436018 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7989344d-4af3-4be9-bfe5-79635119a59f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:21.436464 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7989344d-4af3-4be9-bfe5-79635119a59f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:21.436964 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7989344d-4af3-4be9-bfe5-79635119a59f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:21.576226 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-7989344d-4af3-4be9-bfe5-79635119a59f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:21.584817 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-7989344d-4af3-4be9-bfe5-79635119a59f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:21.586330 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-7989344d-4af3-4be9-bfe5-79635119a59f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:21.587475 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-7989344d-4af3-4be9-bfe5-79635119a59f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1722 microversion: 2.20 time: 0.164793 Aug 10 13:43:21.588045 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 395/755] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:21 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:43:21.600092 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-d77fec4a-55b8-4fc2-b13c-78ded569f25a tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:21.600092 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-d77fec4a-55b8-4fc2-b13c-78ded569f25a tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] [instance: 693851ea-5db1-4eaf-8645-224d9d18406f] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:21.606471 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d77fec4a-55b8-4fc2-b13c-78ded569f25a tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:21.606981 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d77fec4a-55b8-4fc2-b13c-78ded569f25a tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:21.607422 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d77fec4a-55b8-4fc2-b13c-78ded569f25a tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:21.608695 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d77fec4a-55b8-4fc2-b13c-78ded569f25a tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:21.609153 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d77fec4a-55b8-4fc2-b13c-78ded569f25a tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:21.609603 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d77fec4a-55b8-4fc2-b13c-78ded569f25a tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:21.747257 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-d77fec4a-55b8-4fc2-b13c-78ded569f25a tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0e66db98634e028d8706ce14488309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafc9dd5a5341c7a823844c010eb15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:21.754826 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-d77fec4a-55b8-4fc2-b13c-78ded569f25a tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] 10.222.0.52 "GET /compute/v2.1/servers/693851ea-5db1-4eaf-8645-224d9d18406f" status: 200 len: 1503 microversion: 2.1 time: 0.159492 Aug 10 13:43:21.755465 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 361/756] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:43:21 2022] GET /compute/v2.1/servers/693851ea-5db1-4eaf-8645-224d9d18406f => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:43:22.612233 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-ababf8fb-14fd-4611-a279-a613fe8a7c3d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:22.613796 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-ababf8fb-14fd-4611-a279-a613fe8a7c3d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:22.620853 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ababf8fb-14fd-4611-a279-a613fe8a7c3d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:22.622020 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ababf8fb-14fd-4611-a279-a613fe8a7c3d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:22.622549 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ababf8fb-14fd-4611-a279-a613fe8a7c3d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:22.624275 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ababf8fb-14fd-4611-a279-a613fe8a7c3d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:22.624275 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ababf8fb-14fd-4611-a279-a613fe8a7c3d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:22.624576 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ababf8fb-14fd-4611-a279-a613fe8a7c3d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:22.810175 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-ababf8fb-14fd-4611-a279-a613fe8a7c3d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:22.819680 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-ababf8fb-14fd-4611-a279-a613fe8a7c3d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:22.821657 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-ababf8fb-14fd-4611-a279-a613fe8a7c3d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:22.823229 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-ababf8fb-14fd-4611-a279-a613fe8a7c3d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1743 microversion: 2.20 time: 0.215552 Aug 10 13:43:22.823887 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 396/757] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:22 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1743 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:43:22.829175 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-676a5bd5-5c31-4bc0-98dd-015ff53c6105 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:22.829935 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-676a5bd5-5c31-4bc0-98dd-015ff53c6105 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] [instance: 693851ea-5db1-4eaf-8645-224d9d18406f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:22.836649 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-676a5bd5-5c31-4bc0-98dd-015ff53c6105 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:22.837281 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-676a5bd5-5c31-4bc0-98dd-015ff53c6105 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:22.837853 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-676a5bd5-5c31-4bc0-98dd-015ff53c6105 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:22.838669 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-676a5bd5-5c31-4bc0-98dd-015ff53c6105 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:22.839170 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-676a5bd5-5c31-4bc0-98dd-015ff53c6105 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:22.839746 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-676a5bd5-5c31-4bc0-98dd-015ff53c6105 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:22.861623 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-4088776a-a5fa-4e3d-8977-beb65d0ecf78 req-f1147dce-bbb1-4d16-b643-634e6b5f9aae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "693851ea-5db1-4eaf-8645-224d9d18406f", "name": "network-vif-deleted", "tag": "046d544f-5acc-44f6-90d6-4a8780ea539f"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:43:22.871961 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-4088776a-a5fa-4e3d-8977-beb65d0ecf78 req-f1147dce-bbb1-4d16-b643-634e6b5f9aae service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:22.872558 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-4088776a-a5fa-4e3d-8977-beb65d0ecf78 req-f1147dce-bbb1-4d16-b643-634e6b5f9aae service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:22.873128 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-4088776a-a5fa-4e3d-8977-beb65d0ecf78 req-f1147dce-bbb1-4d16-b643-634e6b5f9aae service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:22.875240 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-676a5bd5-5c31-4bc0-98dd-015ff53c6105 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:22.875747 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-676a5bd5-5c31-4bc0-98dd-015ff53c6105 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:22.876241 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-676a5bd5-5c31-4bc0-98dd-015ff53c6105 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:22.876695 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.objects.instance [None req-676a5bd5-5c31-4bc0-98dd-015ff53c6105 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lazy-loading 'fault' on Instance uuid 693851ea-5db1-4eaf-8645-224d9d18406f {{(pid=129522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:43:22.885499 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-4088776a-a5fa-4e3d-8977-beb65d0ecf78 req-f1147dce-bbb1-4d16-b643-634e6b5f9aae service nova] Creating event network-vif-deleted:046d544f-5acc-44f6-90d6-4a8780ea539f for instance 693851ea-5db1-4eaf-8645-224d9d18406f on hv-cinder-85200 Aug 10 13:43:22.891805 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-4088776a-a5fa-4e3d-8977-beb65d0ecf78 req-f1147dce-bbb1-4d16-b643-634e6b5f9aae service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.276833 Aug 10 13:43:22.892609 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 362/758] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:43:22.921168 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-676a5bd5-5c31-4bc0-98dd-015ff53c6105 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0e66db98634e028d8706ce14488309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafc9dd5a5341c7a823844c010eb15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:22.929098 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-676a5bd5-5c31-4bc0-98dd-015ff53c6105 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] 10.222.0.52 "GET /compute/v2.1/servers/693851ea-5db1-4eaf-8645-224d9d18406f" status: 200 len: 1303 microversion: 2.1 time: 0.103935 Aug 10 13:43:22.929730 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 397/759] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:43:22 2022] GET /compute/v2.1/servers/693851ea-5db1-4eaf-8645-224d9d18406f => generated 1303 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:43:23.852100 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-40c3e25e-a8e4-49ec-9e13-76dd9196225f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:23.852814 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-40c3e25e-a8e4-49ec-9e13-76dd9196225f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:23.860139 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-40c3e25e-a8e4-49ec-9e13-76dd9196225f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:23.860629 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-40c3e25e-a8e4-49ec-9e13-76dd9196225f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:23.861063 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-40c3e25e-a8e4-49ec-9e13-76dd9196225f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:23.861803 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-40c3e25e-a8e4-49ec-9e13-76dd9196225f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:23.862368 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-40c3e25e-a8e4-49ec-9e13-76dd9196225f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:23.862710 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-40c3e25e-a8e4-49ec-9e13-76dd9196225f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:23.951347 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-a4633655-3d91-4bf7-8784-f4615cded440 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:23.951959 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-a4633655-3d91-4bf7-8784-f4615cded440 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] [instance: 693851ea-5db1-4eaf-8645-224d9d18406f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:23.958903 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a4633655-3d91-4bf7-8784-f4615cded440 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:23.959392 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a4633655-3d91-4bf7-8784-f4615cded440 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:23.959831 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a4633655-3d91-4bf7-8784-f4615cded440 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:23.960532 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a4633655-3d91-4bf7-8784-f4615cded440 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:23.960980 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a4633655-3d91-4bf7-8784-f4615cded440 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:23.961440 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a4633655-3d91-4bf7-8784-f4615cded440 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:23.976171 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.wsgi [None req-a4633655-3d91-4bf7-8784-f4615cded440 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] HTTP exception thrown: Instance 693851ea-5db1-4eaf-8645-224d9d18406f could not be found. Aug 10 13:43:23.977879 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-a4633655-3d91-4bf7-8784-f4615cded440 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Request method failure captured: Aug 10 13:43:23.977879 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: request: GET /compute/v2.1/servers/693851ea-5db1-4eaf-8645-224d9d18406f HTTP/1.1 Aug 10 13:43:23.977879 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept: application/json Aug 10 13:43:23.977879 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept-Encoding: identity Aug 10 13:43:23.977879 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Connection: close Aug 10 13:43:23.977879 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Length: 0 Aug 10 13:43:23.977879 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Type: application/json Aug 10 13:43:23.977879 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Host: 10.222.0.52 Aug 10 13:43:23.977879 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Openstack-System-Scope: None Aug 10 13:43:23.977879 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: User-Agent: python-urllib3/1.26.11 Aug 10 13:43:23.977879 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Auth-Token: gAAAAABi87XocbGDnFpVu4Gfyb-GlZ-Hv6B4giIwrsb8XZu4xaELjH3znbVXceqka5S2_EvElHVdFmC9gP5u7QyKaN2k8i4wBSQRfv2D8rRkcLHB59iS91xmoqqM8fugevE8aPgWMkN5caiSg5z7NLp1ZaBaYARX14JrsCDAzXSewLamYHFRjK4 Aug 10 13:43:23.977879 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Id: None Aug 10 13:43:23.977879 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Name: None Aug 10 13:43:23.977879 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Identity-Status: Confirmed Aug 10 13:43:23.977879 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Is-Admin-Project: True Aug 10 13:43:23.977879 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Id: default Aug 10 13:43:23.977879 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Name: Default Aug 10 13:43:23.977879 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Id: 6cafc9dd5a5341c7a823844c010eb15a Aug 10 13:43:23.977879 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Name: tempest-VolumesActionsTest-2128544805 Aug 10 13:43:23.977879 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Role: member,reader Aug 10 13:43:23.977879 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Roles: member,reader Aug 10 13:43:23.979482 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6cafc9dd5a5341c7a823844c010eb15a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6cafc9dd5a5341c7a823844c010eb15a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6cafc9dd5a5341c7a823844c010eb15a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6cafc9dd5a5341c7a823844c010eb15a"}]}] Aug 10 13:43:23.979482 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant: tempest-VolumesActionsTest-2128544805 Aug 10 13:43:23.979482 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Id: 6cafc9dd5a5341c7a823844c010eb15a Aug 10 13:43:23.979482 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Name: tempest-VolumesActionsTest-2128544805 Aug 10 13:43:23.979482 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User: tempest-VolumesActionsTest-2128544805-project Aug 10 13:43:23.979482 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Id: default Aug 10 13:43:23.979482 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Name: Default Aug 10 13:43:23.979482 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Id: ed0e66db98634e028d8706ce14488309 Aug 10 13:43:23.979482 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Name: tempest-VolumesActionsTest-2128544805-project Aug 10 13:43:23.979482 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: method: > Aug 10 13:43:23.979482 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: exception: Instance 693851ea-5db1-4eaf-8645-224d9d18406f could not be found. Aug 10 13:43:23.979482 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: action_args: {'id': '693851ea-5db1-4eaf-8645-224d9d18406f'} Aug 10 13:43:23.980666 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:43:23.980666 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:43:23.980666 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:43:23.980666 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:43:23.980666 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:43:23.980666 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:43:23.980666 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:43:23.980666 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:43:23.980666 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:43:23.980666 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:43:23.980666 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 693851ea-5db1-4eaf-8645-224d9d18406f could not be found. Aug 10 13:43:23.980666 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:43:23.980666 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:43:23.980666 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:43:23.980666 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:43:23.980666 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:43:23.980666 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:43:23.980666 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:43:23.980666 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:43:23.980666 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:43:23.984024 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:43:23.984024 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:43:23.984024 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:43:23.984024 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:43:23.984024 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:43:23.984024 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:43:23.984024 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:43:23.984024 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 693851ea-5db1-4eaf-8645-224d9d18406f could not be found. Aug 10 13:43:23.984024 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:43:23.984024 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:43:23.984024 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:43:23.984024 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:43:23.984024 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:43:23.984024 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:43:23.984024 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:43:23.984024 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:43:23.984024 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 693851ea-5db1-4eaf-8645-224d9d18406f could not be found. Aug 10 13:43:23.984024 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:43:23.987036 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-a4633655-3d91-4bf7-8784-f4615cded440 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Returning 404 to user: Instance 693851ea-5db1-4eaf-8645-224d9d18406f could not be found. {{(pid=129522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:43:23.987036 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-a4633655-3d91-4bf7-8784-f4615cded440 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] 10.222.0.52 "GET /compute/v2.1/servers/693851ea-5db1-4eaf-8645-224d9d18406f" status: 404 len: 111 microversion: 2.1 time: 0.031878 Aug 10 13:43:23.987036 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 398/760] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:43:23 2022] GET /compute/v2.1/servers/693851ea-5db1-4eaf-8645-224d9d18406f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 13:43:24.008470 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-40c3e25e-a8e4-49ec-9e13-76dd9196225f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:24.017370 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-40c3e25e-a8e4-49ec-9e13-76dd9196225f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:24.018868 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-40c3e25e-a8e4-49ec-9e13-76dd9196225f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:24.020057 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-40c3e25e-a8e4-49ec-9e13-76dd9196225f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1743 microversion: 2.20 time: 0.172806 Aug 10 13:43:24.020624 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 363/761] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:23 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1743 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:43:24.092546 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-d7866fde-d0dc-4d4a-b046-43c66c4c817f tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2140778674", "imageRef": "096d81df-12b1-4175-b914-babe0fa931c6", "flavorRef": "452", "networks": [{"uuid": "ed686501-dbb5-4b9c-8cbc-aefc13e39e97"}]}} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:43:24.148360 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.network.neutron [None req-d7866fde-d0dc-4d4a-b046-43c66c4c817f tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] validate_networks() for [('ed686501-dbb5-4b9c-8cbc-aefc13e39e97', None, None, None, None, None)] {{(pid=129522) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:43:24.521752 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.virt.hardware [None req-d7866fde-d0dc-4d4a-b046-43c66c4c817f tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Flavor limits 0:0:0 {{(pid=129522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:43:24.522404 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.virt.hardware [None req-d7866fde-d0dc-4d4a-b046-43c66c4c817f tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Image limits 0:0:0 {{(pid=129522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:43:24.522874 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.virt.hardware [None req-d7866fde-d0dc-4d4a-b046-43c66c4c817f tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Flavor pref 0:0:0 {{(pid=129522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:43:24.523305 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.virt.hardware [None req-d7866fde-d0dc-4d4a-b046-43c66c4c817f tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Image pref 0:0:0 {{(pid=129522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:43:24.523741 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.virt.hardware [None req-d7866fde-d0dc-4d4a-b046-43c66c4c817f tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:43:24.532368 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d7866fde-d0dc-4d4a-b046-43c66c4c817f tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:24.532848 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d7866fde-d0dc-4d4a-b046-43c66c4c817f tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:24.533930 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d7866fde-d0dc-4d4a-b046-43c66c4c817f tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:24.534173 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d7866fde-d0dc-4d4a-b046-43c66c4c817f tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:24.534757 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d7866fde-d0dc-4d4a-b046-43c66c4c817f tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:24.535068 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d7866fde-d0dc-4d4a-b046-43c66c4c817f tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:24.549751 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:43:24.555637 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.quota [None req-d7866fde-d0dc-4d4a-b046-43c66c4c817f tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Getting quotas for project 6cafc9dd5a5341c7a823844c010eb15a. Resources: {'cores', 'ram', 'instances'} {{(pid=129522) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:43:24.560040 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.quota [None req-d7866fde-d0dc-4d4a-b046-43c66c4c817f tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Getting quotas for user ed0e66db98634e028d8706ce14488309 and project 6cafc9dd5a5341c7a823844c010eb15a. Resources: {'cores', 'ram', 'instances'} {{(pid=129522) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:43:24.572377 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-d7866fde-d0dc-4d4a-b046-43c66c4c817f tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Going to run 1 instances... {{(pid=129522) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:43:24.574571 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-d7866fde-d0dc-4d4a-b046-43c66c4c817f tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] [instance: be53cf49-aedd-4ef3-98ef-6d7a52950d66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='096d81df-12b1-4175-b914-babe0fa931c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129522) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:43:24.620952 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-d7866fde-d0dc-4d4a-b046-43c66c4c817f tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.532244 Aug 10 13:43:24.622281 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 399/762] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 10 13:43:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 13:43:24.632548 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-0adb61af-84a7-44e0-bcb9-3181f78cf1b6 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:24.633476 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-0adb61af-84a7-44e0-bcb9-3181f78cf1b6 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] [instance: be53cf49-aedd-4ef3-98ef-6d7a52950d66] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:24.692562 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-0adb61af-84a7-44e0-bcb9-3181f78cf1b6 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0e66db98634e028d8706ce14488309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafc9dd5a5341c7a823844c010eb15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:24.699972 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-0adb61af-84a7-44e0-bcb9-3181f78cf1b6 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] 10.222.0.52 "GET /compute/v2.1/servers/be53cf49-aedd-4ef3-98ef-6d7a52950d66" status: 200 len: 1214 microversion: 2.1 time: 0.071221 Aug 10 13:43:24.700725 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 364/763] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:43:24 2022] GET /compute/v2.1/servers/be53cf49-aedd-4ef3-98ef-6d7a52950d66 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:43:25.052083 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-bc827090-02ca-465b-bee9-5a9659078fb5 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:25.052720 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-bc827090-02ca-465b-bee9-5a9659078fb5 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:25.061311 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-bc827090-02ca-465b-bee9-5a9659078fb5 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:25.061836 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-bc827090-02ca-465b-bee9-5a9659078fb5 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:25.062275 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-bc827090-02ca-465b-bee9-5a9659078fb5 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:25.062993 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-bc827090-02ca-465b-bee9-5a9659078fb5 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:25.063450 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-bc827090-02ca-465b-bee9-5a9659078fb5 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:25.063878 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-bc827090-02ca-465b-bee9-5a9659078fb5 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:25.253529 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-bc827090-02ca-465b-bee9-5a9659078fb5 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:25.261893 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-bc827090-02ca-465b-bee9-5a9659078fb5 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:25.263902 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-bc827090-02ca-465b-bee9-5a9659078fb5 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:25.265306 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-bc827090-02ca-465b-bee9-5a9659078fb5 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1738 microversion: 2.20 time: 0.219224 Aug 10 13:43:25.265961 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 400/764] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:25 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1738 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:43:25.720840 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-a8cfe26c-483e-4c7e-82a5-446fac806921 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:25.721742 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-a8cfe26c-483e-4c7e-82a5-446fac806921 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] [instance: be53cf49-aedd-4ef3-98ef-6d7a52950d66] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:25.735683 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a8cfe26c-483e-4c7e-82a5-446fac806921 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:25.736459 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a8cfe26c-483e-4c7e-82a5-446fac806921 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:25.737183 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a8cfe26c-483e-4c7e-82a5-446fac806921 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:25.738407 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a8cfe26c-483e-4c7e-82a5-446fac806921 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:25.738927 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a8cfe26c-483e-4c7e-82a5-446fac806921 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:25.739442 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a8cfe26c-483e-4c7e-82a5-446fac806921 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:25.914751 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-a8cfe26c-483e-4c7e-82a5-446fac806921 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0e66db98634e028d8706ce14488309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafc9dd5a5341c7a823844c010eb15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:25.929548 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-a8cfe26c-483e-4c7e-82a5-446fac806921 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] 10.222.0.52 "GET /compute/v2.1/servers/be53cf49-aedd-4ef3-98ef-6d7a52950d66" status: 200 len: 1274 microversion: 2.1 time: 0.212429 Aug 10 13:43:25.931364 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 365/765] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:43:25 2022] GET /compute/v2.1/servers/be53cf49-aedd-4ef3-98ef-6d7a52950d66 => generated 1274 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:43:26.291127 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-15b9423c-d2b4-47ae-973d-10aba6249c24 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:26.292181 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-15b9423c-d2b4-47ae-973d-10aba6249c24 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:26.305577 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-15b9423c-d2b4-47ae-973d-10aba6249c24 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:26.306084 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-15b9423c-d2b4-47ae-973d-10aba6249c24 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:26.306526 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-15b9423c-d2b4-47ae-973d-10aba6249c24 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:26.307234 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-15b9423c-d2b4-47ae-973d-10aba6249c24 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:26.307697 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-15b9423c-d2b4-47ae-973d-10aba6249c24 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:26.311088 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-15b9423c-d2b4-47ae-973d-10aba6249c24 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:26.553220 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-15b9423c-d2b4-47ae-973d-10aba6249c24 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:26.563381 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-15b9423c-d2b4-47ae-973d-10aba6249c24 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:26.567721 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-15b9423c-d2b4-47ae-973d-10aba6249c24 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:26.569212 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-15b9423c-d2b4-47ae-973d-10aba6249c24 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1738 microversion: 2.20 time: 0.282511 Aug 10 13:43:26.572975 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 401/766] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:26 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1738 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:43:26.827149 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-938c8895-dd31-407a-9184-e60e00c79ae5 req-6e956474-481d-4639-b604-2e0bc482cf5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa512f7-4b23-46bf-aa72-a3f72f2e122f", "name": "network-vif-plugged", "status": "completed", "tag": "1c042378-ea6a-4e4d-a088-c806fdfbe4e9"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:43:26.850733 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-938c8895-dd31-407a-9184-e60e00c79ae5 req-6e956474-481d-4639-b604-2e0bc482cf5f service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:26.852940 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-938c8895-dd31-407a-9184-e60e00c79ae5 req-6e956474-481d-4639-b604-2e0bc482cf5f service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:26.854975 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-938c8895-dd31-407a-9184-e60e00c79ae5 req-6e956474-481d-4639-b604-2e0bc482cf5f service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:26.873549 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-938c8895-dd31-407a-9184-e60e00c79ae5 req-6e956474-481d-4639-b604-2e0bc482cf5f service nova] Creating event network-vif-plugged:1c042378-ea6a-4e4d-a088-c806fdfbe4e9 for instance 3aa512f7-4b23-46bf-aa72-a3f72f2e122f on hv-cinder-85200 Aug 10 13:43:26.881221 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-938c8895-dd31-407a-9184-e60e00c79ae5 req-6e956474-481d-4639-b604-2e0bc482cf5f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156327 Aug 10 13:43:26.887000 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 366/767] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:43:26.961024 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-df1e49d5-0791-4384-8410-3101a7fdc7ad tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:26.961950 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-df1e49d5-0791-4384-8410-3101a7fdc7ad tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] [instance: be53cf49-aedd-4ef3-98ef-6d7a52950d66] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:26.970060 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-df1e49d5-0791-4384-8410-3101a7fdc7ad tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:26.971132 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-df1e49d5-0791-4384-8410-3101a7fdc7ad tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:26.971935 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-df1e49d5-0791-4384-8410-3101a7fdc7ad tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:26.973320 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-df1e49d5-0791-4384-8410-3101a7fdc7ad tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:26.983856 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-df1e49d5-0791-4384-8410-3101a7fdc7ad tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:26.984674 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-df1e49d5-0791-4384-8410-3101a7fdc7ad tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:27.178700 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-df1e49d5-0791-4384-8410-3101a7fdc7ad tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0e66db98634e028d8706ce14488309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafc9dd5a5341c7a823844c010eb15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:27.194565 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-df1e49d5-0791-4384-8410-3101a7fdc7ad tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] 10.222.0.52 "GET /compute/v2.1/servers/be53cf49-aedd-4ef3-98ef-6d7a52950d66" status: 200 len: 1314 microversion: 2.1 time: 0.238132 Aug 10 13:43:27.195333 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 402/768] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:43:26 2022] GET /compute/v2.1/servers/be53cf49-aedd-4ef3-98ef-6d7a52950d66 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:43:27.618062 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-9ebc2aed-07e8-4577-ac91-582e6ef86122 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:27.619108 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-9ebc2aed-07e8-4577-ac91-582e6ef86122 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:27.626160 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9ebc2aed-07e8-4577-ac91-582e6ef86122 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:27.626995 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9ebc2aed-07e8-4577-ac91-582e6ef86122 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:27.627641 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9ebc2aed-07e8-4577-ac91-582e6ef86122 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:27.628351 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9ebc2aed-07e8-4577-ac91-582e6ef86122 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:27.628986 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9ebc2aed-07e8-4577-ac91-582e6ef86122 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:27.629822 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9ebc2aed-07e8-4577-ac91-582e6ef86122 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:27.915449 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-9ebc2aed-07e8-4577-ac91-582e6ef86122 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:27.943949 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-9ebc2aed-07e8-4577-ac91-582e6ef86122 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:27.947027 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-9ebc2aed-07e8-4577-ac91-582e6ef86122 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:27.949758 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-9ebc2aed-07e8-4577-ac91-582e6ef86122 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1738 microversion: 2.20 time: 0.339984 Aug 10 13:43:27.965846 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 367/769] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:27 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1738 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:43:27.973830 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-8aff5baf-17b5-4f3a-bef2-758f6264bcad req-affc91a0-0d42-4b0c-9a38-e19a353acd82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be53cf49-aedd-4ef3-98ef-6d7a52950d66", "tag": "8666848e-6b62-4ce5-92dd-82f53a808012"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:43:27.991665 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-8aff5baf-17b5-4f3a-bef2-758f6264bcad req-affc91a0-0d42-4b0c-9a38-e19a353acd82 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:27.992860 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-8aff5baf-17b5-4f3a-bef2-758f6264bcad req-affc91a0-0d42-4b0c-9a38-e19a353acd82 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:27.993861 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-8aff5baf-17b5-4f3a-bef2-758f6264bcad req-affc91a0-0d42-4b0c-9a38-e19a353acd82 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:28.020286 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-8aff5baf-17b5-4f3a-bef2-758f6264bcad req-affc91a0-0d42-4b0c-9a38-e19a353acd82 service nova] Creating event network-changed:8666848e-6b62-4ce5-92dd-82f53a808012 for instance be53cf49-aedd-4ef3-98ef-6d7a52950d66 on hv-cinder-85200 Aug 10 13:43:28.026952 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-8aff5baf-17b5-4f3a-bef2-758f6264bcad req-affc91a0-0d42-4b0c-9a38-e19a353acd82 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058002 Aug 10 13:43:28.032146 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 403/770] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:43:28.222264 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-7f31ea18-8792-4491-afd9-ba1c84ef3536 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:28.224136 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-7f31ea18-8792-4491-afd9-ba1c84ef3536 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] [instance: be53cf49-aedd-4ef3-98ef-6d7a52950d66] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:28.233952 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7f31ea18-8792-4491-afd9-ba1c84ef3536 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:28.234459 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7f31ea18-8792-4491-afd9-ba1c84ef3536 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:28.234899 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7f31ea18-8792-4491-afd9-ba1c84ef3536 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:28.235631 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7f31ea18-8792-4491-afd9-ba1c84ef3536 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:28.236096 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7f31ea18-8792-4491-afd9-ba1c84ef3536 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:28.236521 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7f31ea18-8792-4491-afd9-ba1c84ef3536 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:28.544089 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-7f31ea18-8792-4491-afd9-ba1c84ef3536 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0e66db98634e028d8706ce14488309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafc9dd5a5341c7a823844c010eb15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:28.567327 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-7f31ea18-8792-4491-afd9-ba1c84ef3536 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] 10.222.0.52 "GET /compute/v2.1/servers/be53cf49-aedd-4ef3-98ef-6d7a52950d66" status: 200 len: 1314 microversion: 2.1 time: 0.354819 Aug 10 13:43:28.568800 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 368/771] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:43:28 2022] GET /compute/v2.1/servers/be53cf49-aedd-4ef3-98ef-6d7a52950d66 => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:43:28.981927 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-3f83c68e-dd4f-465a-aac2-3ceb8102d9b2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:28.984083 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-3f83c68e-dd4f-465a-aac2-3ceb8102d9b2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:28.991240 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3f83c68e-dd4f-465a-aac2-3ceb8102d9b2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:28.991993 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3f83c68e-dd4f-465a-aac2-3ceb8102d9b2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:28.992422 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3f83c68e-dd4f-465a-aac2-3ceb8102d9b2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:28.993123 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3f83c68e-dd4f-465a-aac2-3ceb8102d9b2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:28.993611 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3f83c68e-dd4f-465a-aac2-3ceb8102d9b2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:28.994221 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3f83c68e-dd4f-465a-aac2-3ceb8102d9b2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:29.166938 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-3f83c68e-dd4f-465a-aac2-3ceb8102d9b2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:29.177146 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-3f83c68e-dd4f-465a-aac2-3ceb8102d9b2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:29.178707 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-3f83c68e-dd4f-465a-aac2-3ceb8102d9b2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:29.179948 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-3f83c68e-dd4f-465a-aac2-3ceb8102d9b2 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1738 microversion: 2.20 time: 0.203620 Aug 10 13:43:29.180684 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 404/772] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:28 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1738 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:43:29.591972 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-fa9f9816-37b4-48bf-89bc-e452b14a232c tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:29.593381 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-fa9f9816-37b4-48bf-89bc-e452b14a232c tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] [instance: be53cf49-aedd-4ef3-98ef-6d7a52950d66] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:29.602339 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-fa9f9816-37b4-48bf-89bc-e452b14a232c tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:29.603535 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-fa9f9816-37b4-48bf-89bc-e452b14a232c tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:29.604526 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-fa9f9816-37b4-48bf-89bc-e452b14a232c tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:29.605420 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-fa9f9816-37b4-48bf-89bc-e452b14a232c tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:29.606132 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-fa9f9816-37b4-48bf-89bc-e452b14a232c tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:29.606787 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-fa9f9816-37b4-48bf-89bc-e452b14a232c tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:29.852682 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-fa9f9816-37b4-48bf-89bc-e452b14a232c tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0e66db98634e028d8706ce14488309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafc9dd5a5341c7a823844c010eb15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:29.863846 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-fa9f9816-37b4-48bf-89bc-e452b14a232c tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] 10.222.0.52 "GET /compute/v2.1/servers/be53cf49-aedd-4ef3-98ef-6d7a52950d66" status: 200 len: 1314 microversion: 2.1 time: 0.275425 Aug 10 13:43:29.864479 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 369/773] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:43:29 2022] GET /compute/v2.1/servers/be53cf49-aedd-4ef3-98ef-6d7a52950d66 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:43:30.205215 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-d953f9ed-3acd-4c33-881a-740f27a79f0e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:30.209182 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-d953f9ed-3acd-4c33-881a-740f27a79f0e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:30.216784 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d953f9ed-3acd-4c33-881a-740f27a79f0e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:30.217291 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d953f9ed-3acd-4c33-881a-740f27a79f0e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:30.218322 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d953f9ed-3acd-4c33-881a-740f27a79f0e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:30.218470 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d953f9ed-3acd-4c33-881a-740f27a79f0e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:30.218883 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d953f9ed-3acd-4c33-881a-740f27a79f0e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:30.219306 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d953f9ed-3acd-4c33-881a-740f27a79f0e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:30.379116 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-d953f9ed-3acd-4c33-881a-740f27a79f0e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:30.394342 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-d953f9ed-3acd-4c33-881a-740f27a79f0e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:30.397048 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-d953f9ed-3acd-4c33-881a-740f27a79f0e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:30.398879 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-d953f9ed-3acd-4c33-881a-740f27a79f0e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1738 microversion: 2.20 time: 0.199511 Aug 10 13:43:30.400289 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 405/774] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:30 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1738 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:43:30.886341 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-8abc634b-4c2f-43ed-a523-9caa15c55c73 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:30.887760 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-8abc634b-4c2f-43ed-a523-9caa15c55c73 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] [instance: be53cf49-aedd-4ef3-98ef-6d7a52950d66] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:30.896193 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8abc634b-4c2f-43ed-a523-9caa15c55c73 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:30.896775 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8abc634b-4c2f-43ed-a523-9caa15c55c73 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:30.897338 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8abc634b-4c2f-43ed-a523-9caa15c55c73 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:30.898279 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8abc634b-4c2f-43ed-a523-9caa15c55c73 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:30.898804 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8abc634b-4c2f-43ed-a523-9caa15c55c73 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:30.899296 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8abc634b-4c2f-43ed-a523-9caa15c55c73 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:31.051755 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-8abc634b-4c2f-43ed-a523-9caa15c55c73 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0e66db98634e028d8706ce14488309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafc9dd5a5341c7a823844c010eb15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:31.062810 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-8abc634b-4c2f-43ed-a523-9caa15c55c73 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] 10.222.0.52 "GET /compute/v2.1/servers/be53cf49-aedd-4ef3-98ef-6d7a52950d66" status: 200 len: 1314 microversion: 2.1 time: 0.178791 Aug 10 13:43:31.068101 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 370/775] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:43:30 2022] GET /compute/v2.1/servers/be53cf49-aedd-4ef3-98ef-6d7a52950d66 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:43:31.422386 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-fe82d3ab-632a-4417-9b57-e72810080d9f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:31.423830 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-fe82d3ab-632a-4417-9b57-e72810080d9f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:31.431292 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fe82d3ab-632a-4417-9b57-e72810080d9f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:31.431967 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fe82d3ab-632a-4417-9b57-e72810080d9f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:31.432235 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fe82d3ab-632a-4417-9b57-e72810080d9f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:31.432902 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fe82d3ab-632a-4417-9b57-e72810080d9f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:31.433499 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fe82d3ab-632a-4417-9b57-e72810080d9f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:31.433923 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fe82d3ab-632a-4417-9b57-e72810080d9f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:31.601758 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-fe82d3ab-632a-4417-9b57-e72810080d9f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:31.615656 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-fe82d3ab-632a-4417-9b57-e72810080d9f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:31.617184 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-fe82d3ab-632a-4417-9b57-e72810080d9f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:31.618381 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-fe82d3ab-632a-4417-9b57-e72810080d9f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1738 microversion: 2.20 time: 0.200033 Aug 10 13:43:31.618948 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 406/776] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:31 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1738 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:43:32.086762 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-6b82c9c1-79ce-4032-8468-65b9735b2374 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:32.087587 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-6b82c9c1-79ce-4032-8468-65b9735b2374 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] [instance: be53cf49-aedd-4ef3-98ef-6d7a52950d66] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:32.094934 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6b82c9c1-79ce-4032-8468-65b9735b2374 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:32.095424 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6b82c9c1-79ce-4032-8468-65b9735b2374 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:32.099004 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6b82c9c1-79ce-4032-8468-65b9735b2374 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:32.100439 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6b82c9c1-79ce-4032-8468-65b9735b2374 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:32.101192 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6b82c9c1-79ce-4032-8468-65b9735b2374 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:32.101951 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6b82c9c1-79ce-4032-8468-65b9735b2374 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:32.267233 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-6b82c9c1-79ce-4032-8468-65b9735b2374 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0e66db98634e028d8706ce14488309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafc9dd5a5341c7a823844c010eb15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:32.277541 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-6b82c9c1-79ce-4032-8468-65b9735b2374 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] 10.222.0.52 "GET /compute/v2.1/servers/be53cf49-aedd-4ef3-98ef-6d7a52950d66" status: 200 len: 1314 microversion: 2.1 time: 0.197203 Aug 10 13:43:32.279792 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 371/777] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:43:32 2022] GET /compute/v2.1/servers/be53cf49-aedd-4ef3-98ef-6d7a52950d66 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:43:32.647531 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-ae943503-3ef4-4095-b34b-66b7e459f116 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:32.649042 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-ae943503-3ef4-4095-b34b-66b7e459f116 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:32.657162 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ae943503-3ef4-4095-b34b-66b7e459f116 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:32.658104 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ae943503-3ef4-4095-b34b-66b7e459f116 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:32.658655 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ae943503-3ef4-4095-b34b-66b7e459f116 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:32.659455 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ae943503-3ef4-4095-b34b-66b7e459f116 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:32.660053 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ae943503-3ef4-4095-b34b-66b7e459f116 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:32.660611 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ae943503-3ef4-4095-b34b-66b7e459f116 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:32.762885 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-d9ca6b71-9176-4fb0-b8b5-11ceb70fc69a req-1be67757-73e1-4240-9b01-55e9357cf6dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be53cf49-aedd-4ef3-98ef-6d7a52950d66", "name": "network-vif-plugged", "status": "completed", "tag": "8666848e-6b62-4ce5-92dd-82f53a808012"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:43:32.785372 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-d9ca6b71-9176-4fb0-b8b5-11ceb70fc69a req-1be67757-73e1-4240-9b01-55e9357cf6dc service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:32.786190 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-d9ca6b71-9176-4fb0-b8b5-11ceb70fc69a req-1be67757-73e1-4240-9b01-55e9357cf6dc service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:32.786946 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-d9ca6b71-9176-4fb0-b8b5-11ceb70fc69a req-1be67757-73e1-4240-9b01-55e9357cf6dc service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:32.815381 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-d9ca6b71-9176-4fb0-b8b5-11ceb70fc69a req-1be67757-73e1-4240-9b01-55e9357cf6dc service nova] Creating event network-vif-plugged:8666848e-6b62-4ce5-92dd-82f53a808012 for instance be53cf49-aedd-4ef3-98ef-6d7a52950d66 on hv-cinder-85200 Aug 10 13:43:32.829438 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-d9ca6b71-9176-4fb0-b8b5-11ceb70fc69a req-1be67757-73e1-4240-9b01-55e9357cf6dc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072849 Aug 10 13:43:32.830293 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 372/778] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:43:32.852528 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-ae943503-3ef4-4095-b34b-66b7e459f116 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:32.870530 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-ae943503-3ef4-4095-b34b-66b7e459f116 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:32.872507 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-ae943503-3ef4-4095-b34b-66b7e459f116 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:32.874339 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-ae943503-3ef4-4095-b34b-66b7e459f116 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1738 microversion: 2.20 time: 0.234129 Aug 10 13:43:32.875351 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 407/779] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:32 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1738 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:43:33.300126 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-b5d4d89e-ad07-4d2b-bbf4-69c84e393c33 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:33.301942 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-b5d4d89e-ad07-4d2b-bbf4-69c84e393c33 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] [instance: be53cf49-aedd-4ef3-98ef-6d7a52950d66] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:33.313212 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b5d4d89e-ad07-4d2b-bbf4-69c84e393c33 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:33.314094 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b5d4d89e-ad07-4d2b-bbf4-69c84e393c33 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:33.314473 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b5d4d89e-ad07-4d2b-bbf4-69c84e393c33 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:33.315237 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b5d4d89e-ad07-4d2b-bbf4-69c84e393c33 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:33.315692 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b5d4d89e-ad07-4d2b-bbf4-69c84e393c33 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:33.316110 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b5d4d89e-ad07-4d2b-bbf4-69c84e393c33 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:33.474810 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-b5d4d89e-ad07-4d2b-bbf4-69c84e393c33 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0e66db98634e028d8706ce14488309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafc9dd5a5341c7a823844c010eb15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:33.487632 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-b5d4d89e-ad07-4d2b-bbf4-69c84e393c33 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] 10.222.0.52 "GET /compute/v2.1/servers/be53cf49-aedd-4ef3-98ef-6d7a52950d66" status: 200 len: 1314 microversion: 2.1 time: 0.191754 Aug 10 13:43:33.502833 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 373/780] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:43:33 2022] GET /compute/v2.1/servers/be53cf49-aedd-4ef3-98ef-6d7a52950d66 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:43:33.901388 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-ef62e32d-a401-4ecb-b150-30edb7bb0a4b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:33.902147 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-ef62e32d-a401-4ecb-b150-30edb7bb0a4b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:33.914809 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ef62e32d-a401-4ecb-b150-30edb7bb0a4b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:33.915639 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ef62e32d-a401-4ecb-b150-30edb7bb0a4b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:33.916430 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ef62e32d-a401-4ecb-b150-30edb7bb0a4b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:33.917571 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ef62e32d-a401-4ecb-b150-30edb7bb0a4b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:33.918360 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ef62e32d-a401-4ecb-b150-30edb7bb0a4b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:33.918827 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ef62e32d-a401-4ecb-b150-30edb7bb0a4b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:34.091596 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-ef62e32d-a401-4ecb-b150-30edb7bb0a4b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:34.100388 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-ef62e32d-a401-4ecb-b150-30edb7bb0a4b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:34.101956 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-ef62e32d-a401-4ecb-b150-30edb7bb0a4b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:34.103201 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-ef62e32d-a401-4ecb-b150-30edb7bb0a4b tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1738 microversion: 2.20 time: 0.206034 Aug 10 13:43:34.103975 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 408/781] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:33 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1738 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:43:34.508391 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-eae4915c-4af4-4fa3-9a86-6cf0d9421546 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:34.509010 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-eae4915c-4af4-4fa3-9a86-6cf0d9421546 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] [instance: be53cf49-aedd-4ef3-98ef-6d7a52950d66] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:34.516951 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-eae4915c-4af4-4fa3-9a86-6cf0d9421546 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:34.517486 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-eae4915c-4af4-4fa3-9a86-6cf0d9421546 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:34.517927 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-eae4915c-4af4-4fa3-9a86-6cf0d9421546 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:34.518633 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-eae4915c-4af4-4fa3-9a86-6cf0d9421546 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:34.519088 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-eae4915c-4af4-4fa3-9a86-6cf0d9421546 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:34.519512 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-eae4915c-4af4-4fa3-9a86-6cf0d9421546 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:34.672640 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-eae4915c-4af4-4fa3-9a86-6cf0d9421546 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0e66db98634e028d8706ce14488309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafc9dd5a5341c7a823844c010eb15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:34.681480 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-eae4915c-4af4-4fa3-9a86-6cf0d9421546 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] 10.222.0.52 "GET /compute/v2.1/servers/be53cf49-aedd-4ef3-98ef-6d7a52950d66" status: 200 len: 1314 microversion: 2.1 time: 0.176922 Aug 10 13:43:34.694470 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 374/782] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:43:34 2022] GET /compute/v2.1/servers/be53cf49-aedd-4ef3-98ef-6d7a52950d66 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:43:35.127841 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-a9fde696-7800-4270-99f9-9b4bb571486f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:35.128559 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-a9fde696-7800-4270-99f9-9b4bb571486f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:35.130665 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell0:SELECT=2 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:43:35.131787 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell0:SELECT=6 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:43:35.139008 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a9fde696-7800-4270-99f9-9b4bb571486f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:35.139610 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a9fde696-7800-4270-99f9-9b4bb571486f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:35.139916 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a9fde696-7800-4270-99f9-9b4bb571486f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:35.140593 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a9fde696-7800-4270-99f9-9b4bb571486f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:35.141042 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a9fde696-7800-4270-99f9-9b4bb571486f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:35.141494 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a9fde696-7800-4270-99f9-9b4bb571486f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:35.269828 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-a9fde696-7800-4270-99f9-9b4bb571486f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:35.278099 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-a9fde696-7800-4270-99f9-9b4bb571486f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:35.279971 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-a9fde696-7800-4270-99f9-9b4bb571486f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:35.281190 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-a9fde696-7800-4270-99f9-9b4bb571486f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1738 microversion: 2.20 time: 0.157180 Aug 10 13:43:35.281768 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 409/783] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:35 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:43:35.704324 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-46c6855b-8788-4318-8076-e2a11ecc106f tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:35.704904 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-46c6855b-8788-4318-8076-e2a11ecc106f tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] [instance: be53cf49-aedd-4ef3-98ef-6d7a52950d66] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:35.706925 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell0:SELECT=2 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:43:35.713315 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-46c6855b-8788-4318-8076-e2a11ecc106f tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:35.713806 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-46c6855b-8788-4318-8076-e2a11ecc106f tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:35.714227 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-46c6855b-8788-4318-8076-e2a11ecc106f tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:35.714913 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-46c6855b-8788-4318-8076-e2a11ecc106f tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:35.715364 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-46c6855b-8788-4318-8076-e2a11ecc106f tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:35.715778 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-46c6855b-8788-4318-8076-e2a11ecc106f tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:35.917976 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-46c6855b-8788-4318-8076-e2a11ecc106f tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0e66db98634e028d8706ce14488309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafc9dd5a5341c7a823844c010eb15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:35.926017 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-46c6855b-8788-4318-8076-e2a11ecc106f tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] 10.222.0.52 "GET /compute/v2.1/servers/be53cf49-aedd-4ef3-98ef-6d7a52950d66" status: 200 len: 1498 microversion: 2.1 time: 0.225624 Aug 10 13:43:35.926581 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 375/784] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:43:35 2022] GET /compute/v2.1/servers/be53cf49-aedd-4ef3-98ef-6d7a52950d66 => generated 1498 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:43:36.307609 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-4f815388-b433-4155-936f-147da97635a6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:36.308365 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-4f815388-b433-4155-936f-147da97635a6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:36.314889 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4f815388-b433-4155-936f-147da97635a6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:36.315378 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4f815388-b433-4155-936f-147da97635a6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:36.315814 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4f815388-b433-4155-936f-147da97635a6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:36.316508 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4f815388-b433-4155-936f-147da97635a6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:36.316968 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4f815388-b433-4155-936f-147da97635a6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:36.317507 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4f815388-b433-4155-936f-147da97635a6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:36.401367 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-05f4a898-b354-4fa7-9288-cb06af844153 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:36.401903 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-05f4a898-b354-4fa7-9288-cb06af844153 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] [instance: be53cf49-aedd-4ef3-98ef-6d7a52950d66] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:36.408626 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-05f4a898-b354-4fa7-9288-cb06af844153 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:36.409178 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-05f4a898-b354-4fa7-9288-cb06af844153 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:36.409716 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-05f4a898-b354-4fa7-9288-cb06af844153 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:36.414492 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-05f4a898-b354-4fa7-9288-cb06af844153 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:36.414492 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-05f4a898-b354-4fa7-9288-cb06af844153 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:36.414492 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-05f4a898-b354-4fa7-9288-cb06af844153 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:36.440302 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-05f4a898-b354-4fa7-9288-cb06af844153 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] [instance: be53cf49-aedd-4ef3-98ef-6d7a52950d66] Going to try to terminate instance {{(pid=129523) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:43:36.449439 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-4f815388-b433-4155-936f-147da97635a6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:36.455121 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:43:36.458500 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-4f815388-b433-4155-936f-147da97635a6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:36.460002 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-4f815388-b433-4155-936f-147da97635a6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:36.461200 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-4f815388-b433-4155-936f-147da97635a6 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1720 microversion: 2.20 time: 0.157691 Aug 10 13:43:36.461779 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 410/785] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:36 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:43:36.518040 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-05f4a898-b354-4fa7-9288-cb06af844153 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] 10.222.0.52 "DELETE /compute/v2.1/servers/be53cf49-aedd-4ef3-98ef-6d7a52950d66" status: 204 len: 0 microversion: 2.1 time: 0.120473 Aug 10 13:43:36.518595 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 376/786] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 10 13:43:36 2022] DELETE /compute/v2.1/servers/be53cf49-aedd-4ef3-98ef-6d7a52950d66 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 13:43:36.526613 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-04c1826d-7b9b-4644-a4d3-c04b4509f579 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:36.527221 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-04c1826d-7b9b-4644-a4d3-c04b4509f579 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] [instance: be53cf49-aedd-4ef3-98ef-6d7a52950d66] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:36.533705 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-04c1826d-7b9b-4644-a4d3-c04b4509f579 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:36.534180 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-04c1826d-7b9b-4644-a4d3-c04b4509f579 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:36.534604 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-04c1826d-7b9b-4644-a4d3-c04b4509f579 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:36.535280 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-04c1826d-7b9b-4644-a4d3-c04b4509f579 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:36.535748 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-04c1826d-7b9b-4644-a4d3-c04b4509f579 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:36.536160 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-04c1826d-7b9b-4644-a4d3-c04b4509f579 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:36.671091 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-04c1826d-7b9b-4644-a4d3-c04b4509f579 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0e66db98634e028d8706ce14488309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafc9dd5a5341c7a823844c010eb15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:36.673307 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell1:SELECT=100 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:43:36.679858 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-04c1826d-7b9b-4644-a4d3-c04b4509f579 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] 10.222.0.52 "GET /compute/v2.1/servers/be53cf49-aedd-4ef3-98ef-6d7a52950d66" status: 200 len: 1504 microversion: 2.1 time: 0.157016 Aug 10 13:43:36.680444 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 411/787] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:43:36 2022] GET /compute/v2.1/servers/be53cf49-aedd-4ef3-98ef-6d7a52950d66 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:43:37.486024 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-84f06ea3-e31a-4527-b889-872fdb3d20da tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:37.486720 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-84f06ea3-e31a-4527-b889-872fdb3d20da tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:37.493077 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-84f06ea3-e31a-4527-b889-872fdb3d20da tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:37.493591 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-84f06ea3-e31a-4527-b889-872fdb3d20da tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:37.494024 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-84f06ea3-e31a-4527-b889-872fdb3d20da tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:37.494705 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-84f06ea3-e31a-4527-b889-872fdb3d20da tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:37.495158 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-84f06ea3-e31a-4527-b889-872fdb3d20da tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:37.495578 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-84f06ea3-e31a-4527-b889-872fdb3d20da tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:37.624849 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-84f06ea3-e31a-4527-b889-872fdb3d20da tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:37.632665 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-84f06ea3-e31a-4527-b889-872fdb3d20da tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:37.634167 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-84f06ea3-e31a-4527-b889-872fdb3d20da tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:37.635312 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-84f06ea3-e31a-4527-b889-872fdb3d20da tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1720 microversion: 2.20 time: 0.154183 Aug 10 13:43:37.635866 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 377/788] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:37 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:43:37.701520 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-da232fc0-e724-449c-be3e-f2b482c706f0 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:37.702128 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-da232fc0-e724-449c-be3e-f2b482c706f0 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] [instance: be53cf49-aedd-4ef3-98ef-6d7a52950d66] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:37.708452 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-da232fc0-e724-449c-be3e-f2b482c706f0 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:37.708927 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-da232fc0-e724-449c-be3e-f2b482c706f0 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:37.709388 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-da232fc0-e724-449c-be3e-f2b482c706f0 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:37.710065 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-da232fc0-e724-449c-be3e-f2b482c706f0 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:37.710508 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-da232fc0-e724-449c-be3e-f2b482c706f0 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:37.710923 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-da232fc0-e724-449c-be3e-f2b482c706f0 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:37.838412 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-da232fc0-e724-449c-be3e-f2b482c706f0 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0e66db98634e028d8706ce14488309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafc9dd5a5341c7a823844c010eb15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:37.846422 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-da232fc0-e724-449c-be3e-f2b482c706f0 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] 10.222.0.52 "GET /compute/v2.1/servers/be53cf49-aedd-4ef3-98ef-6d7a52950d66" status: 200 len: 1504 microversion: 2.1 time: 0.149227 Aug 10 13:43:37.846980 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 412/789] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:43:37 2022] GET /compute/v2.1/servers/be53cf49-aedd-4ef3-98ef-6d7a52950d66 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:43:38.648064 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-2d5b1b7c-2535-49cb-8ee7-bae9870e3c27 req-50629dda-0ff2-4d41-ab35-af54e50312f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa512f7-4b23-46bf-aa72-a3f72f2e122f", "name": "network-vif-unplugged", "status": "completed", "tag": "1c042378-ea6a-4e4d-a088-c806fdfbe4e9"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:43:38.658885 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-66ec3c8d-4a37-4616-a18c-a865af2f2335 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:38.659646 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-66ec3c8d-4a37-4616-a18c-a865af2f2335 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:38.660021 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-2d5b1b7c-2535-49cb-8ee7-bae9870e3c27 req-50629dda-0ff2-4d41-ab35-af54e50312f7 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:38.660550 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-2d5b1b7c-2535-49cb-8ee7-bae9870e3c27 req-50629dda-0ff2-4d41-ab35-af54e50312f7 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:38.660985 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-2d5b1b7c-2535-49cb-8ee7-bae9870e3c27 req-50629dda-0ff2-4d41-ab35-af54e50312f7 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:38.665554 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-66ec3c8d-4a37-4616-a18c-a865af2f2335 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:38.666040 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-66ec3c8d-4a37-4616-a18c-a865af2f2335 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:38.666503 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-66ec3c8d-4a37-4616-a18c-a865af2f2335 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:38.667201 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-66ec3c8d-4a37-4616-a18c-a865af2f2335 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:38.667650 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-66ec3c8d-4a37-4616-a18c-a865af2f2335 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:38.668068 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-66ec3c8d-4a37-4616-a18c-a865af2f2335 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:38.672684 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-2d5b1b7c-2535-49cb-8ee7-bae9870e3c27 req-50629dda-0ff2-4d41-ab35-af54e50312f7 service nova] Creating event network-vif-unplugged:1c042378-ea6a-4e4d-a088-c806fdfbe4e9 for instance 3aa512f7-4b23-46bf-aa72-a3f72f2e122f on hv-cinder-85200 Aug 10 13:43:38.677867 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-2d5b1b7c-2535-49cb-8ee7-bae9870e3c27 req-50629dda-0ff2-4d41-ab35-af54e50312f7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033392 Aug 10 13:43:38.678621 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 378/790] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:43:38.805829 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-66ec3c8d-4a37-4616-a18c-a865af2f2335 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:38.814142 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-66ec3c8d-4a37-4616-a18c-a865af2f2335 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:38.815631 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-66ec3c8d-4a37-4616-a18c-a865af2f2335 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:38.816786 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-66ec3c8d-4a37-4616-a18c-a865af2f2335 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1720 microversion: 2.20 time: 0.162226 Aug 10 13:43:38.817379 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 413/791] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:38 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:43:38.867559 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-67137603-e86d-4a05-af5c-d136399e540d tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:38.868244 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-67137603-e86d-4a05-af5c-d136399e540d tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] [instance: be53cf49-aedd-4ef3-98ef-6d7a52950d66] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:38.875050 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-67137603-e86d-4a05-af5c-d136399e540d tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:38.875536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-67137603-e86d-4a05-af5c-d136399e540d tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:38.875972 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-67137603-e86d-4a05-af5c-d136399e540d tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:38.876712 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-67137603-e86d-4a05-af5c-d136399e540d tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:38.877166 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-67137603-e86d-4a05-af5c-d136399e540d tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:38.877620 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-67137603-e86d-4a05-af5c-d136399e540d tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:39.009330 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-67137603-e86d-4a05-af5c-d136399e540d tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0e66db98634e028d8706ce14488309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafc9dd5a5341c7a823844c010eb15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:39.017355 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-67137603-e86d-4a05-af5c-d136399e540d tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] 10.222.0.52 "GET /compute/v2.1/servers/be53cf49-aedd-4ef3-98ef-6d7a52950d66" status: 200 len: 1504 microversion: 2.1 time: 0.153846 Aug 10 13:43:39.017920 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 379/792] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:43:38 2022] GET /compute/v2.1/servers/be53cf49-aedd-4ef3-98ef-6d7a52950d66 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:43:39.842666 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-939909c2-3260-47cc-9556-abe5720a3cbf tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:39.843208 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-939909c2-3260-47cc-9556-abe5720a3cbf tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:39.849514 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-939909c2-3260-47cc-9556-abe5720a3cbf tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:39.850003 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-939909c2-3260-47cc-9556-abe5720a3cbf tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:39.850441 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-939909c2-3260-47cc-9556-abe5720a3cbf tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:39.851139 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-939909c2-3260-47cc-9556-abe5720a3cbf tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:39.851593 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-939909c2-3260-47cc-9556-abe5720a3cbf tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:39.852018 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-939909c2-3260-47cc-9556-abe5720a3cbf tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:39.990555 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-939909c2-3260-47cc-9556-abe5720a3cbf tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:39.998880 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-939909c2-3260-47cc-9556-abe5720a3cbf tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:40.000379 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-939909c2-3260-47cc-9556-abe5720a3cbf tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:40.001611 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-939909c2-3260-47cc-9556-abe5720a3cbf tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1663 microversion: 2.20 time: 0.163449 Aug 10 13:43:40.009410 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-4a7a35c5-73bd-4208-bd58-a8b08aedf2d6 req-d30506f6-1d45-435b-8881-99b3e55f6f07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be53cf49-aedd-4ef3-98ef-6d7a52950d66", "name": "network-vif-deleted", "tag": "8666848e-6b62-4ce5-92dd-82f53a808012"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:43:40.017435 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 414/793] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:39 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1663 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:43:40.024214 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-74a5c807-0f60-401d-a98d-0b11ccad24b5 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0183927f-89cf-4002-b4e1-8bb8eb55f8bc"}} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:43:40.026548 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-74a5c807-0f60-401d-a98d-0b11ccad24b5 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:40.027806 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-4a7a35c5-73bd-4208-bd58-a8b08aedf2d6 req-d30506f6-1d45-435b-8881-99b3e55f6f07 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:40.028472 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-4a7a35c5-73bd-4208-bd58-a8b08aedf2d6 req-d30506f6-1d45-435b-8881-99b3e55f6f07 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:40.029343 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-4a7a35c5-73bd-4208-bd58-a8b08aedf2d6 req-d30506f6-1d45-435b-8881-99b3e55f6f07 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:40.033017 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-74a5c807-0f60-401d-a98d-0b11ccad24b5 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:40.033557 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-74a5c807-0f60-401d-a98d-0b11ccad24b5 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:40.034355 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-74a5c807-0f60-401d-a98d-0b11ccad24b5 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:40.035039 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-74a5c807-0f60-401d-a98d-0b11ccad24b5 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:40.035498 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-74a5c807-0f60-401d-a98d-0b11ccad24b5 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:40.035944 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-74a5c807-0f60-401d-a98d-0b11ccad24b5 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:40.044170 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-4a7a35c5-73bd-4208-bd58-a8b08aedf2d6 req-d30506f6-1d45-435b-8881-99b3e55f6f07 service nova] Creating event network-vif-deleted:8666848e-6b62-4ce5-92dd-82f53a808012 for instance be53cf49-aedd-4ef3-98ef-6d7a52950d66 on hv-cinder-85200 Aug 10 13:43:40.050323 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-4a7a35c5-73bd-4208-bd58-a8b08aedf2d6 req-d30506f6-1d45-435b-8881-99b3e55f6f07 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044401 Aug 10 13:43:40.051295 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 380/794] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:43:40.056494 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-c0f44f60-7f3e-4758-989a-694e0a719e21 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:40.057182 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-c0f44f60-7f3e-4758-989a-694e0a719e21 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] [instance: be53cf49-aedd-4ef3-98ef-6d7a52950d66] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:40.064322 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c0f44f60-7f3e-4758-989a-694e0a719e21 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:40.064814 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c0f44f60-7f3e-4758-989a-694e0a719e21 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:40.065261 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c0f44f60-7f3e-4758-989a-694e0a719e21 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:40.065977 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c0f44f60-7f3e-4758-989a-694e0a719e21 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:40.066827 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c0f44f60-7f3e-4758-989a-694e0a719e21 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:40.067396 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c0f44f60-7f3e-4758-989a-694e0a719e21 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:40.140356 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-c0f44f60-7f3e-4758-989a-694e0a719e21 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0e66db98634e028d8706ce14488309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafc9dd5a5341c7a823844c010eb15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:40.147906 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-c0f44f60-7f3e-4758-989a-694e0a719e21 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] 10.222.0.52 "GET /compute/v2.1/servers/be53cf49-aedd-4ef3-98ef-6d7a52950d66" status: 200 len: 1299 microversion: 2.1 time: 0.095374 Aug 10 13:43:40.148471 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 381/795] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:43:40 2022] GET /compute/v2.1/servers/be53cf49-aedd-4ef3-98ef-6d7a52950d66 => generated 1299 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:43:40.317356 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-74a5c807-0f60-401d-a98d-0b11ccad24b5 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "POST /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.296742 Aug 10 13:43:40.317968 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 415/796] 10.222.0.52 () {62 vars in 1364 bytes} [Wed Aug 10 13:43:40 2022] POST /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f/os-volume_attachments => generated 188 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 13:43:40.442954 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-a22c0065-799c-4b48-8745-6c764d6fe867 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:40.443791 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-a22c0065-799c-4b48-8745-6c764d6fe867 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:40.449788 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a22c0065-799c-4b48-8745-6c764d6fe867 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:40.450297 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a22c0065-799c-4b48-8745-6c764d6fe867 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:40.450719 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a22c0065-799c-4b48-8745-6c764d6fe867 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:40.451411 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a22c0065-799c-4b48-8745-6c764d6fe867 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:40.451860 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a22c0065-799c-4b48-8745-6c764d6fe867 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:40.452281 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a22c0065-799c-4b48-8745-6c764d6fe867 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:40.698695 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-a22c0065-799c-4b48-8745-6c764d6fe867 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f/os-volume_attachments/0183927f-89cf-4002-b4e1-8bb8eb55f8bc" status: 202 len: 0 microversion: 2.20 time: 0.259798 Aug 10 13:43:40.699334 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 382/797] 10.222.0.52 () {60 vars in 1457 bytes} [Wed Aug 10 13:43:40 2022] DELETE /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f/os-volume_attachments/0183927f-89cf-4002-b4e1-8bb8eb55f8bc => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:43:40.758677 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-e8b74d82-5605-43ba-8ba1-c65d14343540 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:43:40.759267 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-e8b74d82-5605-43ba-8ba1-c65d14343540 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:40.765154 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e8b74d82-5605-43ba-8ba1-c65d14343540 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:40.765672 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e8b74d82-5605-43ba-8ba1-c65d14343540 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:40.766106 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e8b74d82-5605-43ba-8ba1-c65d14343540 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:40.766791 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e8b74d82-5605-43ba-8ba1-c65d14343540 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:40.767240 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e8b74d82-5605-43ba-8ba1-c65d14343540 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:40.767660 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e8b74d82-5605-43ba-8ba1-c65d14343540 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:40.809204 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-e8b74d82-5605-43ba-8ba1-c65d14343540 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129522) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 10 13:43:40.876233 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-e8b74d82-5605-43ba-8ba1-c65d14343540 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "POST /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f/action" status: 202 len: 0 microversion: 2.20 time: 0.121397 Aug 10 13:43:40.876909 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 416/798] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Aug 10 13:43:40 2022] POST /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:43:40.884887 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-c9b01ccf-fd0c-4d73-b194-54849321a231 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:40.885740 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-c9b01ccf-fd0c-4d73-b194-54849321a231 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:40.893017 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c9b01ccf-fd0c-4d73-b194-54849321a231 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:40.893873 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c9b01ccf-fd0c-4d73-b194-54849321a231 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:40.894328 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c9b01ccf-fd0c-4d73-b194-54849321a231 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:40.895020 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c9b01ccf-fd0c-4d73-b194-54849321a231 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:40.895868 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c9b01ccf-fd0c-4d73-b194-54849321a231 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:40.896604 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c9b01ccf-fd0c-4d73-b194-54849321a231 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:41.037292 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-c9b01ccf-fd0c-4d73-b194-54849321a231 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:41.046007 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-c9b01ccf-fd0c-4d73-b194-54849321a231 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:41.047515 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-c9b01ccf-fd0c-4d73-b194-54849321a231 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:41.048694 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-c9b01ccf-fd0c-4d73-b194-54849321a231 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1671 microversion: 2.20 time: 0.167713 Aug 10 13:43:41.051703 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 383/799] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:40 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1671 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:43:41.168077 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-08c10baa-aef4-4868-b19f-837ef50cd823 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:41.168696 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-08c10baa-aef4-4868-b19f-837ef50cd823 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] [instance: be53cf49-aedd-4ef3-98ef-6d7a52950d66] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:41.175159 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-08c10baa-aef4-4868-b19f-837ef50cd823 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:41.175697 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-08c10baa-aef4-4868-b19f-837ef50cd823 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:41.176073 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-08c10baa-aef4-4868-b19f-837ef50cd823 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:41.180194 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-08c10baa-aef4-4868-b19f-837ef50cd823 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:41.180194 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-08c10baa-aef4-4868-b19f-837ef50cd823 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:41.180194 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-08c10baa-aef4-4868-b19f-837ef50cd823 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:41.191263 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.wsgi [None req-08c10baa-aef4-4868-b19f-837ef50cd823 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] HTTP exception thrown: Instance be53cf49-aedd-4ef3-98ef-6d7a52950d66 could not be found. Aug 10 13:43:41.192907 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-08c10baa-aef4-4868-b19f-837ef50cd823 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Request method failure captured: Aug 10 13:43:41.192907 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: request: GET /compute/v2.1/servers/be53cf49-aedd-4ef3-98ef-6d7a52950d66 HTTP/1.1 Aug 10 13:43:41.192907 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept: application/json Aug 10 13:43:41.192907 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept-Encoding: identity Aug 10 13:43:41.192907 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Connection: close Aug 10 13:43:41.192907 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Length: 0 Aug 10 13:43:41.192907 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Type: application/json Aug 10 13:43:41.192907 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Host: 10.222.0.52 Aug 10 13:43:41.192907 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Openstack-System-Scope: None Aug 10 13:43:41.192907 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: User-Agent: python-urllib3/1.26.11 Aug 10 13:43:41.192907 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Auth-Token: gAAAAABi87XocbGDnFpVu4Gfyb-GlZ-Hv6B4giIwrsb8XZu4xaELjH3znbVXceqka5S2_EvElHVdFmC9gP5u7QyKaN2k8i4wBSQRfv2D8rRkcLHB59iS91xmoqqM8fugevE8aPgWMkN5caiSg5z7NLp1ZaBaYARX14JrsCDAzXSewLamYHFRjK4 Aug 10 13:43:41.192907 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Id: None Aug 10 13:43:41.192907 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Name: None Aug 10 13:43:41.192907 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Identity-Status: Confirmed Aug 10 13:43:41.192907 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Is-Admin-Project: True Aug 10 13:43:41.192907 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Id: default Aug 10 13:43:41.192907 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Name: Default Aug 10 13:43:41.192907 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Id: 6cafc9dd5a5341c7a823844c010eb15a Aug 10 13:43:41.192907 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Name: tempest-VolumesActionsTest-2128544805 Aug 10 13:43:41.192907 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Role: member,reader Aug 10 13:43:41.192907 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Roles: member,reader Aug 10 13:43:41.194545 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6cafc9dd5a5341c7a823844c010eb15a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6cafc9dd5a5341c7a823844c010eb15a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6cafc9dd5a5341c7a823844c010eb15a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6cafc9dd5a5341c7a823844c010eb15a"}]}] Aug 10 13:43:41.194545 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant: tempest-VolumesActionsTest-2128544805 Aug 10 13:43:41.194545 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Id: 6cafc9dd5a5341c7a823844c010eb15a Aug 10 13:43:41.194545 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Name: tempest-VolumesActionsTest-2128544805 Aug 10 13:43:41.194545 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User: tempest-VolumesActionsTest-2128544805-project Aug 10 13:43:41.194545 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Id: default Aug 10 13:43:41.194545 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Name: Default Aug 10 13:43:41.194545 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Id: ed0e66db98634e028d8706ce14488309 Aug 10 13:43:41.194545 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Name: tempest-VolumesActionsTest-2128544805-project Aug 10 13:43:41.194545 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: method: > Aug 10 13:43:41.194545 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: exception: Instance be53cf49-aedd-4ef3-98ef-6d7a52950d66 could not be found. Aug 10 13:43:41.194545 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: action_args: {'id': 'be53cf49-aedd-4ef3-98ef-6d7a52950d66'} Aug 10 13:43:41.195293 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:43:41.195293 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:43:41.195293 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:43:41.195293 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:43:41.195293 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:43:41.195293 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:43:41.195293 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:43:41.195293 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:43:41.195293 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:43:41.195293 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:43:41.195293 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be53cf49-aedd-4ef3-98ef-6d7a52950d66 could not be found. Aug 10 13:43:41.195293 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:43:41.195293 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:43:41.195293 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:43:41.195293 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:43:41.195293 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:43:41.195293 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:43:41.195293 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:43:41.195293 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:43:41.195293 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:43:41.197371 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:43:41.197371 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:43:41.197371 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:43:41.197371 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:43:41.197371 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:43:41.197371 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:43:41.197371 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:43:41.197371 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be53cf49-aedd-4ef3-98ef-6d7a52950d66 could not be found. Aug 10 13:43:41.197371 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:43:41.197371 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:43:41.197371 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:43:41.197371 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:43:41.197371 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:43:41.197371 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:43:41.197371 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:43:41.197371 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:43:41.197371 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be53cf49-aedd-4ef3-98ef-6d7a52950d66 could not be found. Aug 10 13:43:41.197371 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:43:41.198500 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-08c10baa-aef4-4868-b19f-837ef50cd823 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] Returning 404 to user: Instance be53cf49-aedd-4ef3-98ef-6d7a52950d66 could not be found. {{(pid=129522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:43:41.198500 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-08c10baa-aef4-4868-b19f-837ef50cd823 tempest-VolumesActionsTest-2128544805 tempest-VolumesActionsTest-2128544805-project] 10.222.0.52 "GET /compute/v2.1/servers/be53cf49-aedd-4ef3-98ef-6d7a52950d66" status: 404 len: 111 microversion: 2.1 time: 0.030149 Aug 10 13:43:41.198500 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 417/800] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:43:41 2022] GET /compute/v2.1/servers/be53cf49-aedd-4ef3-98ef-6d7a52950d66 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 13:43:42.071896 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-56d25e72-2ca1-45d0-bfcf-70fe067e1d88 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:42.072503 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-56d25e72-2ca1-45d0-bfcf-70fe067e1d88 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:42.078812 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-56d25e72-2ca1-45d0-bfcf-70fe067e1d88 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:42.079292 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-56d25e72-2ca1-45d0-bfcf-70fe067e1d88 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:42.079729 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-56d25e72-2ca1-45d0-bfcf-70fe067e1d88 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:42.080414 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-56d25e72-2ca1-45d0-bfcf-70fe067e1d88 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:42.080864 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-56d25e72-2ca1-45d0-bfcf-70fe067e1d88 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:42.081306 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-56d25e72-2ca1-45d0-bfcf-70fe067e1d88 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:42.277847 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-56d25e72-2ca1-45d0-bfcf-70fe067e1d88 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:42.286388 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-56d25e72-2ca1-45d0-bfcf-70fe067e1d88 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:42.287888 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-56d25e72-2ca1-45d0-bfcf-70fe067e1d88 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:42.289041 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-56d25e72-2ca1-45d0-bfcf-70fe067e1d88 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1729 microversion: 2.20 time: 0.221028 Aug 10 13:43:42.289631 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 384/801] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:42 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1729 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:43:43.312317 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-017603a5-c90c-4b41-b88c-bf317e7d7c7d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:43.312927 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-017603a5-c90c-4b41-b88c-bf317e7d7c7d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:43.319351 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-017603a5-c90c-4b41-b88c-bf317e7d7c7d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:43.319828 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-017603a5-c90c-4b41-b88c-bf317e7d7c7d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:43.320257 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-017603a5-c90c-4b41-b88c-bf317e7d7c7d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:43.320936 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-017603a5-c90c-4b41-b88c-bf317e7d7c7d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:43.321431 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-017603a5-c90c-4b41-b88c-bf317e7d7c7d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:43.321851 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-017603a5-c90c-4b41-b88c-bf317e7d7c7d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:43.447734 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-017603a5-c90c-4b41-b88c-bf317e7d7c7d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:43.455696 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-017603a5-c90c-4b41-b88c-bf317e7d7c7d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:43.457182 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-017603a5-c90c-4b41-b88c-bf317e7d7c7d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:43.458390 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-017603a5-c90c-4b41-b88c-bf317e7d7c7d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1729 microversion: 2.20 time: 0.150428 Aug 10 13:43:43.458926 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 418/802] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:43 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:43:44.481080 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-f5690976-f893-4498-9d13-bc73964a2bde tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:44.482227 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-f5690976-f893-4498-9d13-bc73964a2bde tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:44.488952 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f5690976-f893-4498-9d13-bc73964a2bde tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:44.489486 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f5690976-f893-4498-9d13-bc73964a2bde tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:44.489916 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f5690976-f893-4498-9d13-bc73964a2bde tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:44.490599 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f5690976-f893-4498-9d13-bc73964a2bde tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:44.491051 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f5690976-f893-4498-9d13-bc73964a2bde tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:44.491474 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f5690976-f893-4498-9d13-bc73964a2bde tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:44.620701 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-f5690976-f893-4498-9d13-bc73964a2bde tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:44.628562 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-f5690976-f893-4498-9d13-bc73964a2bde tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:44.630102 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-f5690976-f893-4498-9d13-bc73964a2bde tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:44.631280 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-f5690976-f893-4498-9d13-bc73964a2bde tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1729 microversion: 2.20 time: 0.154069 Aug 10 13:43:44.631839 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 385/803] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:44 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:43:45.662310 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-54939d53-5e38-4c1f-9479-2c414728c55f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:45.663067 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-54939d53-5e38-4c1f-9479-2c414728c55f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:45.669852 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-54939d53-5e38-4c1f-9479-2c414728c55f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:45.670333 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-54939d53-5e38-4c1f-9479-2c414728c55f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:45.670765 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-54939d53-5e38-4c1f-9479-2c414728c55f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:45.671450 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-54939d53-5e38-4c1f-9479-2c414728c55f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:45.671928 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-54939d53-5e38-4c1f-9479-2c414728c55f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:45.672342 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-54939d53-5e38-4c1f-9479-2c414728c55f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:45.806019 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-54939d53-5e38-4c1f-9479-2c414728c55f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:45.814280 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-54939d53-5e38-4c1f-9479-2c414728c55f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:45.815747 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-54939d53-5e38-4c1f-9479-2c414728c55f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:45.816908 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-54939d53-5e38-4c1f-9479-2c414728c55f tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1729 microversion: 2.20 time: 0.158554 Aug 10 13:43:45.817922 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 419/804] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:45 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:43:46.852305 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-bb34f356-6f17-4c99-a97c-2872aeb65b44 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:46.854398 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-bb34f356-6f17-4c99-a97c-2872aeb65b44 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:46.876373 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bb34f356-6f17-4c99-a97c-2872aeb65b44 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:46.877546 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bb34f356-6f17-4c99-a97c-2872aeb65b44 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:46.878554 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bb34f356-6f17-4c99-a97c-2872aeb65b44 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:46.879869 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bb34f356-6f17-4c99-a97c-2872aeb65b44 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:46.880650 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bb34f356-6f17-4c99-a97c-2872aeb65b44 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:46.881795 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-bb34f356-6f17-4c99-a97c-2872aeb65b44 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:47.268383 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-bb34f356-6f17-4c99-a97c-2872aeb65b44 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:47.280206 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-bb34f356-6f17-4c99-a97c-2872aeb65b44 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:47.282253 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-bb34f356-6f17-4c99-a97c-2872aeb65b44 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:47.283884 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-bb34f356-6f17-4c99-a97c-2872aeb65b44 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1729 microversion: 2.20 time: 0.443529 Aug 10 13:43:47.285594 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 386/805] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:46 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1729 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:43:48.311112 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-923d1f6d-a687-43d1-b94f-0d9b6fbd16d3 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:48.311811 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-923d1f6d-a687-43d1-b94f-0d9b6fbd16d3 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:48.320959 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-923d1f6d-a687-43d1-b94f-0d9b6fbd16d3 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:48.333632 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-923d1f6d-a687-43d1-b94f-0d9b6fbd16d3 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:48.334535 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-923d1f6d-a687-43d1-b94f-0d9b6fbd16d3 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:48.335504 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-923d1f6d-a687-43d1-b94f-0d9b6fbd16d3 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:48.336220 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-923d1f6d-a687-43d1-b94f-0d9b6fbd16d3 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:48.336998 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-923d1f6d-a687-43d1-b94f-0d9b6fbd16d3 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:48.594069 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-923d1f6d-a687-43d1-b94f-0d9b6fbd16d3 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:48.603415 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-923d1f6d-a687-43d1-b94f-0d9b6fbd16d3 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:48.605770 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-923d1f6d-a687-43d1-b94f-0d9b6fbd16d3 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:48.608163 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-923d1f6d-a687-43d1-b94f-0d9b6fbd16d3 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1729 microversion: 2.20 time: 0.301190 Aug 10 13:43:48.609360 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 420/806] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:48 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1729 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:43:49.639001 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-f713d455-48db-45af-8583-f168c076eb83 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:49.639705 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-f713d455-48db-45af-8583-f168c076eb83 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:49.642090 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:43:49.647836 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f713d455-48db-45af-8583-f168c076eb83 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:49.648830 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f713d455-48db-45af-8583-f168c076eb83 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:49.649532 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f713d455-48db-45af-8583-f168c076eb83 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:49.650517 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f713d455-48db-45af-8583-f168c076eb83 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:49.651194 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f713d455-48db-45af-8583-f168c076eb83 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:49.651858 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f713d455-48db-45af-8583-f168c076eb83 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:49.826594 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-f713d455-48db-45af-8583-f168c076eb83 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:49.847626 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-f713d455-48db-45af-8583-f168c076eb83 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:49.849780 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-f713d455-48db-45af-8583-f168c076eb83 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:49.851224 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-f713d455-48db-45af-8583-f168c076eb83 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1729 microversion: 2.20 time: 0.216938 Aug 10 13:43:49.852359 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 387/807] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:49 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1729 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:43:50.156721 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-b511abac-8ef9-4343-9a8a-f91b8fbf9b8e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:50.158188 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-b511abac-8ef9-4343-9a8a-f91b8fbf9b8e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 59cf654d-76ac-488e-93ff-ccb46e164602] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:50.165662 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b511abac-8ef9-4343-9a8a-f91b8fbf9b8e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:50.166502 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b511abac-8ef9-4343-9a8a-f91b8fbf9b8e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:50.167092 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b511abac-8ef9-4343-9a8a-f91b8fbf9b8e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:50.167967 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b511abac-8ef9-4343-9a8a-f91b8fbf9b8e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:50.168570 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b511abac-8ef9-4343-9a8a-f91b8fbf9b8e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:50.169180 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b511abac-8ef9-4343-9a8a-f91b8fbf9b8e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:50.195499 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-b511abac-8ef9-4343-9a8a-f91b8fbf9b8e tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602/ips" status: 200 len: 150 microversion: 2.1 time: 0.043230 Aug 10 13:43:50.205425 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 421/808] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Aug 10 13:43:50 2022] GET /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602/ips => generated 150 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:43:50.884077 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-f2da4b7a-cab8-4643-9b2c-cdcf1e375a2e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:50.885458 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-f2da4b7a-cab8-4643-9b2c-cdcf1e375a2e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:50.897009 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f2da4b7a-cab8-4643-9b2c-cdcf1e375a2e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:50.897840 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f2da4b7a-cab8-4643-9b2c-cdcf1e375a2e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:50.898553 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f2da4b7a-cab8-4643-9b2c-cdcf1e375a2e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:50.899476 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f2da4b7a-cab8-4643-9b2c-cdcf1e375a2e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:50.900122 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f2da4b7a-cab8-4643-9b2c-cdcf1e375a2e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:50.900764 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f2da4b7a-cab8-4643-9b2c-cdcf1e375a2e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:51.079133 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-f2da4b7a-cab8-4643-9b2c-cdcf1e375a2e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:51.089481 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-f2da4b7a-cab8-4643-9b2c-cdcf1e375a2e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:51.091719 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-f2da4b7a-cab8-4643-9b2c-cdcf1e375a2e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:51.093066 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-f2da4b7a-cab8-4643-9b2c-cdcf1e375a2e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1729 microversion: 2.20 time: 0.213013 Aug 10 13:43:51.093825 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 388/809] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:50 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1729 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:43:51.765263 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-e4be0628-5493-4b8b-a988-955c3e7d5eb2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb8293c0-3851-4743-b5b5-caaf15417f2d"}} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:43:51.768548 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-e4be0628-5493-4b8b-a988-955c3e7d5eb2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 59cf654d-76ac-488e-93ff-ccb46e164602] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:51.776038 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e4be0628-5493-4b8b-a988-955c3e7d5eb2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:51.776974 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e4be0628-5493-4b8b-a988-955c3e7d5eb2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:51.777694 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e4be0628-5493-4b8b-a988-955c3e7d5eb2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:51.778668 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e4be0628-5493-4b8b-a988-955c3e7d5eb2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:51.779524 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e4be0628-5493-4b8b-a988-955c3e7d5eb2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:51.780203 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e4be0628-5493-4b8b-a988-955c3e7d5eb2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:52.117597 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-b7b9f31b-036d-4d56-ac8e-43d225def4cb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:52.124025 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-b7b9f31b-036d-4d56-ac8e-43d225def4cb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:52.135556 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b7b9f31b-036d-4d56-ac8e-43d225def4cb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:52.136447 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b7b9f31b-036d-4d56-ac8e-43d225def4cb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:52.137128 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b7b9f31b-036d-4d56-ac8e-43d225def4cb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:52.138089 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b7b9f31b-036d-4d56-ac8e-43d225def4cb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:52.138762 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b7b9f31b-036d-4d56-ac8e-43d225def4cb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:52.139401 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b7b9f31b-036d-4d56-ac8e-43d225def4cb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:52.507341 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-b7b9f31b-036d-4d56-ac8e-43d225def4cb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:52.521531 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-b7b9f31b-036d-4d56-ac8e-43d225def4cb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:52.528113 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-b7b9f31b-036d-4d56-ac8e-43d225def4cb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:52.529998 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-b7b9f31b-036d-4d56-ac8e-43d225def4cb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1729 microversion: 2.20 time: 0.416443 Aug 10 13:43:52.530915 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 389/810] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:52 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1729 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:43:53.558634 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-21c092a7-c6f7-4dd7-9394-6581adaf36eb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:53.559796 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-21c092a7-c6f7-4dd7-9394-6581adaf36eb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:53.593571 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-21c092a7-c6f7-4dd7-9394-6581adaf36eb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:53.594837 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-21c092a7-c6f7-4dd7-9394-6581adaf36eb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:53.595844 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-21c092a7-c6f7-4dd7-9394-6581adaf36eb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:53.597886 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-21c092a7-c6f7-4dd7-9394-6581adaf36eb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:53.599543 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-21c092a7-c6f7-4dd7-9394-6581adaf36eb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:53.600865 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-21c092a7-c6f7-4dd7-9394-6581adaf36eb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:53.933044 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-21c092a7-c6f7-4dd7-9394-6581adaf36eb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:53.942669 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-21c092a7-c6f7-4dd7-9394-6581adaf36eb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:53.944274 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-21c092a7-c6f7-4dd7-9394-6581adaf36eb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:53.945531 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-21c092a7-c6f7-4dd7-9394-6581adaf36eb tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1729 microversion: 2.20 time: 0.395525 Aug 10 13:43:53.962118 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 390/811] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:53 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1729 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:43:54.970230 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-47b586b3-595c-4735-8d22-f907eb9548d7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:54.970980 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-47b586b3-595c-4735-8d22-f907eb9548d7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:54.977795 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-47b586b3-595c-4735-8d22-f907eb9548d7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:54.978284 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-47b586b3-595c-4735-8d22-f907eb9548d7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:54.978714 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-47b586b3-595c-4735-8d22-f907eb9548d7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:54.979416 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-47b586b3-595c-4735-8d22-f907eb9548d7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:54.979873 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-47b586b3-595c-4735-8d22-f907eb9548d7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:54.980288 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-47b586b3-595c-4735-8d22-f907eb9548d7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:54.983735 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:43:55.158886 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-47b586b3-595c-4735-8d22-f907eb9548d7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:55.168207 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-47b586b3-595c-4735-8d22-f907eb9548d7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:55.172196 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-47b586b3-595c-4735-8d22-f907eb9548d7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:55.174595 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-47b586b3-595c-4735-8d22-f907eb9548d7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1729 microversion: 2.20 time: 0.208271 Aug 10 13:43:55.175470 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 391/812] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:54 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1729 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:43:56.217857 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-e9ac1160-348e-4e2a-b8c4-a7310131a506 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:56.223358 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-e9ac1160-348e-4e2a-b8c4-a7310131a506 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:56.230822 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e9ac1160-348e-4e2a-b8c4-a7310131a506 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:56.231619 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e9ac1160-348e-4e2a-b8c4-a7310131a506 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:56.232875 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e9ac1160-348e-4e2a-b8c4-a7310131a506 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:56.233847 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e9ac1160-348e-4e2a-b8c4-a7310131a506 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:56.234664 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e9ac1160-348e-4e2a-b8c4-a7310131a506 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:56.235132 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e9ac1160-348e-4e2a-b8c4-a7310131a506 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:56.392846 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-e9ac1160-348e-4e2a-b8c4-a7310131a506 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:56.404166 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-e9ac1160-348e-4e2a-b8c4-a7310131a506 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:56.406033 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-e9ac1160-348e-4e2a-b8c4-a7310131a506 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:56.407769 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-e9ac1160-348e-4e2a-b8c4-a7310131a506 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1729 microversion: 2.20 time: 0.206390 Aug 10 13:43:56.408525 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 392/813] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:56 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1729 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:43:56.858663 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-e4be0628-5493-4b8b-a988-955c3e7d5eb2 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "POST /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.098171 Aug 10 13:43:56.859562 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 422/814] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 10 13:43:51 2022] POST /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602/os-volume_attachments => generated 194 bytes in 5100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:43:57.439469 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-f0da7ff4-d078-4c55-b407-49532d37f6a4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:57.440608 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-f0da7ff4-d078-4c55-b407-49532d37f6a4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:57.457184 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f0da7ff4-d078-4c55-b407-49532d37f6a4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:57.458014 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f0da7ff4-d078-4c55-b407-49532d37f6a4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:57.461047 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f0da7ff4-d078-4c55-b407-49532d37f6a4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:57.462421 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f0da7ff4-d078-4c55-b407-49532d37f6a4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:57.463655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f0da7ff4-d078-4c55-b407-49532d37f6a4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:57.464684 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f0da7ff4-d078-4c55-b407-49532d37f6a4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:57.618802 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-f0da7ff4-d078-4c55-b407-49532d37f6a4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:57.628228 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-f0da7ff4-d078-4c55-b407-49532d37f6a4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:57.629943 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-f0da7ff4-d078-4c55-b407-49532d37f6a4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:57.631489 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-f0da7ff4-d078-4c55-b407-49532d37f6a4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1729 microversion: 2.20 time: 0.203491 Aug 10 13:43:57.632391 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 393/815] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:57 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1729 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:43:58.657189 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-1b556d6e-1ba7-48bc-8c38-f4193b81c9d9 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:58.657989 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-1b556d6e-1ba7-48bc-8c38-f4193b81c9d9 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:58.661958 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:43:58.667818 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1b556d6e-1ba7-48bc-8c38-f4193b81c9d9 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:58.668489 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1b556d6e-1ba7-48bc-8c38-f4193b81c9d9 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:58.669520 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1b556d6e-1ba7-48bc-8c38-f4193b81c9d9 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:58.670464 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1b556d6e-1ba7-48bc-8c38-f4193b81c9d9 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:58.670925 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1b556d6e-1ba7-48bc-8c38-f4193b81c9d9 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:58.671378 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1b556d6e-1ba7-48bc-8c38-f4193b81c9d9 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:58.823437 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-1b556d6e-1ba7-48bc-8c38-f4193b81c9d9 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:58.833780 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-1b556d6e-1ba7-48bc-8c38-f4193b81c9d9 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:58.835560 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-1b556d6e-1ba7-48bc-8c38-f4193b81c9d9 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:43:58.836967 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-1b556d6e-1ba7-48bc-8c38-f4193b81c9d9 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1729 microversion: 2.20 time: 0.184823 Aug 10 13:43:58.853536 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 423/816] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:58 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1729 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:43:59.861441 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-e8c2fba0-bcf5-46d4-bcb5-9ee1c4628f4e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:43:59.862309 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-e8c2fba0-bcf5-46d4-bcb5-9ee1c4628f4e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:43:59.870103 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e8c2fba0-bcf5-46d4-bcb5-9ee1c4628f4e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:59.870939 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e8c2fba0-bcf5-46d4-bcb5-9ee1c4628f4e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:59.871459 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e8c2fba0-bcf5-46d4-bcb5-9ee1c4628f4e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:43:59.873296 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e8c2fba0-bcf5-46d4-bcb5-9ee1c4628f4e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:43:59.873870 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e8c2fba0-bcf5-46d4-bcb5-9ee1c4628f4e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:43:59.874566 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e8c2fba0-bcf5-46d4-bcb5-9ee1c4628f4e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:00.029963 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-e8c2fba0-bcf5-46d4-bcb5-9ee1c4628f4e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:00.047235 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-e8c2fba0-bcf5-46d4-bcb5-9ee1c4628f4e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:00.048767 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-e8c2fba0-bcf5-46d4-bcb5-9ee1c4628f4e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:00.050013 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-e8c2fba0-bcf5-46d4-bcb5-9ee1c4628f4e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1729 microversion: 2.20 time: 0.192772 Aug 10 13:44:00.051070 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 394/817] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:43:59 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1729 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:44:01.080439 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-a1e0f404-88da-4087-99e8-31ab9cd14e8e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:01.081510 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-a1e0f404-88da-4087-99e8-31ab9cd14e8e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:01.082588 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-04227fe0-b516-4a17-8b02-b157cd03db31 req-292055f4-8a44-4686-b018-c5c6dd100b53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa512f7-4b23-46bf-aa72-a3f72f2e122f", "name": "network-vif-plugged", "status": "completed", "tag": "1c042378-ea6a-4e4d-a088-c806fdfbe4e9"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:44:01.096435 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a1e0f404-88da-4087-99e8-31ab9cd14e8e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:01.097788 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a1e0f404-88da-4087-99e8-31ab9cd14e8e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:01.100900 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a1e0f404-88da-4087-99e8-31ab9cd14e8e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:01.104435 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a1e0f404-88da-4087-99e8-31ab9cd14e8e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:01.108997 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a1e0f404-88da-4087-99e8-31ab9cd14e8e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:01.109850 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a1e0f404-88da-4087-99e8-31ab9cd14e8e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:01.113628 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-04227fe0-b516-4a17-8b02-b157cd03db31 req-292055f4-8a44-4686-b018-c5c6dd100b53 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:01.114757 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-04227fe0-b516-4a17-8b02-b157cd03db31 req-292055f4-8a44-4686-b018-c5c6dd100b53 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:01.117155 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-04227fe0-b516-4a17-8b02-b157cd03db31 req-292055f4-8a44-4686-b018-c5c6dd100b53 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:01.136832 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-04227fe0-b516-4a17-8b02-b157cd03db31 req-292055f4-8a44-4686-b018-c5c6dd100b53 service nova] Creating event network-vif-plugged:1c042378-ea6a-4e4d-a088-c806fdfbe4e9 for instance 3aa512f7-4b23-46bf-aa72-a3f72f2e122f on hv-cinder-85200 Aug 10 13:44:01.159381 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-04227fe0-b516-4a17-8b02-b157cd03db31 req-292055f4-8a44-4686-b018-c5c6dd100b53 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091823 Aug 10 13:44:01.165960 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 424/818] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:44:01.349160 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-a1e0f404-88da-4087-99e8-31ab9cd14e8e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:01.357561 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-a1e0f404-88da-4087-99e8-31ab9cd14e8e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:01.360110 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-a1e0f404-88da-4087-99e8-31ab9cd14e8e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:01.361457 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-a1e0f404-88da-4087-99e8-31ab9cd14e8e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1729 microversion: 2.20 time: 0.291938 Aug 10 13:44:01.362432 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 395/819] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:44:01 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1729 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:44:02.386459 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-4517783c-0d84-4954-b9f9-9fe1d8538e92 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:02.387369 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-4517783c-0d84-4954-b9f9-9fe1d8538e92 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:02.396454 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4517783c-0d84-4954-b9f9-9fe1d8538e92 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:02.397004 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4517783c-0d84-4954-b9f9-9fe1d8538e92 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:02.397657 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4517783c-0d84-4954-b9f9-9fe1d8538e92 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:02.399369 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4517783c-0d84-4954-b9f9-9fe1d8538e92 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:02.399819 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4517783c-0d84-4954-b9f9-9fe1d8538e92 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:02.400628 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4517783c-0d84-4954-b9f9-9fe1d8538e92 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:02.416467 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=5,nova_cell1:UPDATE=7 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:44:02.541690 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-4517783c-0d84-4954-b9f9-9fe1d8538e92 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:02.550647 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-4517783c-0d84-4954-b9f9-9fe1d8538e92 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:02.552168 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-4517783c-0d84-4954-b9f9-9fe1d8538e92 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:02.553463 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-4517783c-0d84-4954-b9f9-9fe1d8538e92 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1729 microversion: 2.20 time: 0.172373 Aug 10 13:44:02.554028 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 425/820] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:44:02 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:44:03.291236 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-cf37f185-6fdf-4abe-9d9e-44d4d1064813 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:03.291736 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-cf37f185-6fdf-4abe-9d9e-44d4d1064813 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 3d30c2bb-a513-4a88-a9e4-3cf892bda262] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:03.298433 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cf37f185-6fdf-4abe-9d9e-44d4d1064813 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:03.298987 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cf37f185-6fdf-4abe-9d9e-44d4d1064813 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:03.299425 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cf37f185-6fdf-4abe-9d9e-44d4d1064813 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:03.300121 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cf37f185-6fdf-4abe-9d9e-44d4d1064813 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:03.300617 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cf37f185-6fdf-4abe-9d9e-44d4d1064813 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:03.300980 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cf37f185-6fdf-4abe-9d9e-44d4d1064813 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:03.325870 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-cf37f185-6fdf-4abe-9d9e-44d4d1064813 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262/ips" status: 200 len: 144 microversion: 2.1 time: 0.037807 Aug 10 13:44:03.326321 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 396/821] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Aug 10 13:44:03 2022] GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262/ips => generated 144 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:44:03.579150 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-2e332232-d015-4b9d-b6be-56f1835d878e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:03.580160 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-2e332232-d015-4b9d-b6be-56f1835d878e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:03.587322 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2e332232-d015-4b9d-b6be-56f1835d878e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:03.587804 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2e332232-d015-4b9d-b6be-56f1835d878e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:03.588233 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2e332232-d015-4b9d-b6be-56f1835d878e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:03.588921 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2e332232-d015-4b9d-b6be-56f1835d878e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:03.589680 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2e332232-d015-4b9d-b6be-56f1835d878e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:03.590345 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2e332232-d015-4b9d-b6be-56f1835d878e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:03.727980 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-2e332232-d015-4b9d-b6be-56f1835d878e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:03.736487 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-2e332232-d015-4b9d-b6be-56f1835d878e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:03.738260 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-2e332232-d015-4b9d-b6be-56f1835d878e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:03.739455 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-2e332232-d015-4b9d-b6be-56f1835d878e tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1729 microversion: 2.20 time: 0.166039 Aug 10 13:44:03.740161 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 426/822] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:44:03 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:44:04.694579 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-57da7ad0-8a7a-44c9-8964-c6323cd93e7c tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a1ec6ef-5989-47c4-b666-51d800ed75f0"}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:44:04.697139 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-57da7ad0-8a7a-44c9-8964-c6323cd93e7c tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 3d30c2bb-a513-4a88-a9e4-3cf892bda262] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:04.704702 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-57da7ad0-8a7a-44c9-8964-c6323cd93e7c tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:04.705838 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-57da7ad0-8a7a-44c9-8964-c6323cd93e7c tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:04.706385 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-57da7ad0-8a7a-44c9-8964-c6323cd93e7c tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:04.707200 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-57da7ad0-8a7a-44c9-8964-c6323cd93e7c tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:04.707764 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-57da7ad0-8a7a-44c9-8964-c6323cd93e7c tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:04.708654 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-57da7ad0-8a7a-44c9-8964-c6323cd93e7c tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:04.748113 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-ae0327d2-4c9a-458e-bfbc-0e4dcd9fecdb tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:04.748604 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-ae0327d2-4c9a-458e-bfbc-0e4dcd9fecdb tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 59cf654d-76ac-488e-93ff-ccb46e164602] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:04.758556 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ae0327d2-4c9a-458e-bfbc-0e4dcd9fecdb tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:04.759759 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ae0327d2-4c9a-458e-bfbc-0e4dcd9fecdb tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:04.760200 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ae0327d2-4c9a-458e-bfbc-0e4dcd9fecdb tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:04.761399 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ae0327d2-4c9a-458e-bfbc-0e4dcd9fecdb tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:04.761811 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ae0327d2-4c9a-458e-bfbc-0e4dcd9fecdb tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:04.762865 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-ae0327d2-4c9a-458e-bfbc-0e4dcd9fecdb tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:04.868966 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.objects.instance [None req-ae0327d2-4c9a-458e-bfbc-0e4dcd9fecdb tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lazy-loading 'services' on Instance uuid 59cf654d-76ac-488e-93ff-ccb46e164602 {{(pid=129522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:44:04.967969 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-ae0327d2-4c9a-458e-bfbc-0e4dcd9fecdb tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "DELETE /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602/os-volume_attachments/eb8293c0-3851-4743-b5b5-caaf15417f2d" status: 202 len: 0 microversion: 2.1 time: 0.221663 Aug 10 13:44:04.970896 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 427/823] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Aug 10 13:44:04 2022] DELETE /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602/os-volume_attachments/eb8293c0-3851-4743-b5b5-caaf15417f2d => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:44:04.980639 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-20db9124-023f-4043-8461-49a75989ff5a tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:04.981585 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-20db9124-023f-4043-8461-49a75989ff5a tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:04.989351 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-20db9124-023f-4043-8461-49a75989ff5a tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:04.990154 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-20db9124-023f-4043-8461-49a75989ff5a tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:04.990417 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-57da7ad0-8a7a-44c9-8964-c6323cd93e7c tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "POST /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300010 Aug 10 13:44:04.990716 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-20db9124-023f-4043-8461-49a75989ff5a tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:04.994673 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 397/824] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 10 13:44:04 2022] POST /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:44:04.994780 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-20db9124-023f-4043-8461-49a75989ff5a tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:04.994780 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-20db9124-023f-4043-8461-49a75989ff5a tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:04.994780 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-20db9124-023f-4043-8461-49a75989ff5a tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:05.002924 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-e64c0014-702b-4c06-9241-e741514593f4 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:05.010529 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-e64c0014-702b-4c06-9241-e741514593f4 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 59cf654d-76ac-488e-93ff-ccb46e164602] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:05.022642 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e64c0014-702b-4c06-9241-e741514593f4 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:05.023397 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e64c0014-702b-4c06-9241-e741514593f4 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:05.024586 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e64c0014-702b-4c06-9241-e741514593f4 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:05.025895 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e64c0014-702b-4c06-9241-e741514593f4 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:05.026440 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e64c0014-702b-4c06-9241-e741514593f4 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:05.026978 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e64c0014-702b-4c06-9241-e741514593f4 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:05.064364 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-e64c0014-702b-4c06-9241-e741514593f4 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071235 Aug 10 13:44:05.065368 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 398/825] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 10 13:44:04 2022] GET /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:44:05.159828 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-20db9124-023f-4043-8461-49a75989ff5a tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:05.168052 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-20db9124-023f-4043-8461-49a75989ff5a tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:05.170323 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-20db9124-023f-4043-8461-49a75989ff5a tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:05.171482 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-20db9124-023f-4043-8461-49a75989ff5a tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1716 microversion: 2.20 time: 0.199227 Aug 10 13:44:05.172048 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 428/826] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:44:04 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1716 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:44:06.078669 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-cb330100-2d35-4ce5-8af6-8e820e628eac tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:06.081094 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-cb330100-2d35-4ce5-8af6-8e820e628eac tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 59cf654d-76ac-488e-93ff-ccb46e164602] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:06.087380 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cb330100-2d35-4ce5-8af6-8e820e628eac tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:06.087868 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cb330100-2d35-4ce5-8af6-8e820e628eac tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:06.088305 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cb330100-2d35-4ce5-8af6-8e820e628eac tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:06.088997 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cb330100-2d35-4ce5-8af6-8e820e628eac tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:06.089666 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cb330100-2d35-4ce5-8af6-8e820e628eac tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:06.090090 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cb330100-2d35-4ce5-8af6-8e820e628eac tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:06.118372 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-cb330100-2d35-4ce5-8af6-8e820e628eac tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044312 Aug 10 13:44:06.119179 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 399/827] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 10 13:44:06 2022] GET /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 13:44:06.180791 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-f0045328-e671-4cfc-ba47-d7fa7b4df474 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:06.181301 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-f0045328-e671-4cfc-ba47-d7fa7b4df474 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 59cf654d-76ac-488e-93ff-ccb46e164602] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:06.188298 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f0045328-e671-4cfc-ba47-d7fa7b4df474 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:06.188732 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f0045328-e671-4cfc-ba47-d7fa7b4df474 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:06.189169 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f0045328-e671-4cfc-ba47-d7fa7b4df474 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:06.189882 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f0045328-e671-4cfc-ba47-d7fa7b4df474 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:06.190337 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f0045328-e671-4cfc-ba47-d7fa7b4df474 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:06.190761 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f0045328-e671-4cfc-ba47-d7fa7b4df474 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:06.217817 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-f0045328-e671-4cfc-ba47-d7fa7b4df474 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 59cf654d-76ac-488e-93ff-ccb46e164602] Going to try to terminate instance {{(pid=129522) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:44:06.297447 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-f0045328-e671-4cfc-ba47-d7fa7b4df474 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "DELETE /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602" status: 204 len: 0 microversion: 2.1 time: 0.119776 Aug 10 13:44:06.298465 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 429/828] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 10 13:44:06 2022] DELETE /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:44:06.306700 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-fcf3c372-6eae-4124-9898-bd195379b6f4 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:06.307422 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-fcf3c372-6eae-4124-9898-bd195379b6f4 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 59cf654d-76ac-488e-93ff-ccb46e164602] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:06.313940 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-fcf3c372-6eae-4124-9898-bd195379b6f4 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:06.314452 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-fcf3c372-6eae-4124-9898-bd195379b6f4 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:06.314872 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-fcf3c372-6eae-4124-9898-bd195379b6f4 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:06.315550 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-fcf3c372-6eae-4124-9898-bd195379b6f4 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:06.316001 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-fcf3c372-6eae-4124-9898-bd195379b6f4 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:06.316419 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-fcf3c372-6eae-4124-9898-bd195379b6f4 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:06.445787 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-fcf3c372-6eae-4124-9898-bd195379b6f4 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:06.453638 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-fcf3c372-6eae-4124-9898-bd195379b6f4 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602" status: 200 len: 1682 microversion: 2.1 time: 0.150652 Aug 10 13:44:06.454204 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 400/829] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:44:06 2022] GET /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:44:07.475759 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-af88b359-81ca-4ad9-8b8f-7fe4625a1c5b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:07.476456 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-af88b359-81ca-4ad9-8b8f-7fe4625a1c5b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 59cf654d-76ac-488e-93ff-ccb46e164602] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:07.483459 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-af88b359-81ca-4ad9-8b8f-7fe4625a1c5b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:07.483938 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-af88b359-81ca-4ad9-8b8f-7fe4625a1c5b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:07.484369 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-af88b359-81ca-4ad9-8b8f-7fe4625a1c5b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:07.485051 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-af88b359-81ca-4ad9-8b8f-7fe4625a1c5b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:07.485531 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-af88b359-81ca-4ad9-8b8f-7fe4625a1c5b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:07.485950 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-af88b359-81ca-4ad9-8b8f-7fe4625a1c5b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:07.617952 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-af88b359-81ca-4ad9-8b8f-7fe4625a1c5b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:07.625275 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-af88b359-81ca-4ad9-8b8f-7fe4625a1c5b tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602" status: 200 len: 1682 microversion: 2.1 time: 0.153740 Aug 10 13:44:07.625841 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 430/830] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:44:07 2022] GET /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:44:08.646168 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-b5e86c20-9473-49d2-85d7-ed8376113fb6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:08.647352 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-b5e86c20-9473-49d2-85d7-ed8376113fb6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 59cf654d-76ac-488e-93ff-ccb46e164602] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:08.654340 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b5e86c20-9473-49d2-85d7-ed8376113fb6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:08.655258 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b5e86c20-9473-49d2-85d7-ed8376113fb6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:08.655853 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b5e86c20-9473-49d2-85d7-ed8376113fb6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:08.656706 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b5e86c20-9473-49d2-85d7-ed8376113fb6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:08.657346 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b5e86c20-9473-49d2-85d7-ed8376113fb6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:08.657922 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b5e86c20-9473-49d2-85d7-ed8376113fb6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:08.674546 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-71a0a6eb-21bd-46a7-b0fb-35251178c06c req-96d0c78f-55eb-4ef7-9689-f1fd5faefaed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59cf654d-76ac-488e-93ff-ccb46e164602", "name": "network-vif-deleted", "tag": "4a041ea6-0120-4d1d-86df-1010d3fafa8b"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:44:08.697098 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-71a0a6eb-21bd-46a7-b0fb-35251178c06c req-96d0c78f-55eb-4ef7-9689-f1fd5faefaed service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:08.698014 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-71a0a6eb-21bd-46a7-b0fb-35251178c06c req-96d0c78f-55eb-4ef7-9689-f1fd5faefaed service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:08.700412 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-71a0a6eb-21bd-46a7-b0fb-35251178c06c req-96d0c78f-55eb-4ef7-9689-f1fd5faefaed service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:08.724908 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-71a0a6eb-21bd-46a7-b0fb-35251178c06c req-96d0c78f-55eb-4ef7-9689-f1fd5faefaed service nova] Creating event network-vif-deleted:4a041ea6-0120-4d1d-86df-1010d3fafa8b for instance 59cf654d-76ac-488e-93ff-ccb46e164602 on hv-cinder-85200 Aug 10 13:44:08.730700 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-71a0a6eb-21bd-46a7-b0fb-35251178c06c req-96d0c78f-55eb-4ef7-9689-f1fd5faefaed service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062821 Aug 10 13:44:08.736815 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 431/831] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:44:08.737407 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-b5e86c20-9473-49d2-85d7-ed8376113fb6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9e5dc719c430eac6b5c8d8b814566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e5556cbbfd4b00aa4f6055cd6238b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:08.747501 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-b5e86c20-9473-49d2-85d7-ed8376113fb6 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602" status: 200 len: 1614 microversion: 2.1 time: 0.104519 Aug 10 13:44:08.762137 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 401/832] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:44:08 2022] GET /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602 => generated 1614 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:44:09.771428 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-c67ac4bf-eaa2-47e0-9898-2e53af8012ff tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:09.772049 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-c67ac4bf-eaa2-47e0-9898-2e53af8012ff tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 59cf654d-76ac-488e-93ff-ccb46e164602] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:09.779690 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c67ac4bf-eaa2-47e0-9898-2e53af8012ff tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:09.780139 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c67ac4bf-eaa2-47e0-9898-2e53af8012ff tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:09.780573 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c67ac4bf-eaa2-47e0-9898-2e53af8012ff tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:09.781297 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c67ac4bf-eaa2-47e0-9898-2e53af8012ff tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:09.781753 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c67ac4bf-eaa2-47e0-9898-2e53af8012ff tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:09.782172 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c67ac4bf-eaa2-47e0-9898-2e53af8012ff tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:09.797679 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.wsgi [None req-c67ac4bf-eaa2-47e0-9898-2e53af8012ff tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] HTTP exception thrown: Instance 59cf654d-76ac-488e-93ff-ccb46e164602 could not be found. Aug 10 13:44:09.799396 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-c67ac4bf-eaa2-47e0-9898-2e53af8012ff tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Request method failure captured: Aug 10 13:44:09.799396 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: request: GET /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602 HTTP/1.1 Aug 10 13:44:09.799396 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept: application/json Aug 10 13:44:09.799396 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept-Encoding: identity Aug 10 13:44:09.799396 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Connection: close Aug 10 13:44:09.799396 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Length: 0 Aug 10 13:44:09.799396 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Type: application/json Aug 10 13:44:09.799396 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Host: 10.222.0.52 Aug 10 13:44:09.799396 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Openstack-System-Scope: None Aug 10 13:44:09.799396 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: User-Agent: python-urllib3/1.26.11 Aug 10 13:44:09.799396 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Auth-Token: gAAAAABi87Sor1QukN8WwkCMRH0utTzHqdtW9hBypcULvW8_thEN8NIRbRb3dRFY62pVCieUmq7t4p3U1aqc6NH3mLhkTq5eSrbHxF5HfdCRrvoVeQ0o3DpawgBQQZEUeD2RccyRTg2LrZLPb9H0A6tO9wPr-HvRM84fUPq4D0GzK22Ap72p14g Aug 10 13:44:09.799396 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Id: None Aug 10 13:44:09.799396 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Name: None Aug 10 13:44:09.799396 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Identity-Status: Confirmed Aug 10 13:44:09.799396 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Is-Admin-Project: True Aug 10 13:44:09.799396 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Id: default Aug 10 13:44:09.799396 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Name: Default Aug 10 13:44:09.799396 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Id: 48e5556cbbfd4b00aa4f6055cd6238b2 Aug 10 13:44:09.799396 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Name: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:44:09.799396 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Role: member,reader Aug 10 13:44:09.799396 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Roles: member,reader Aug 10 13:44:09.801048 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/48e5556cbbfd4b00aa4f6055cd6238b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48e5556cbbfd4b00aa4f6055cd6238b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_48e5556cbbfd4b00aa4f6055cd6238b2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48e5556cbbfd4b00aa4f6055cd6238b2"}]}] Aug 10 13:44:09.801048 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:44:09.801048 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Id: 48e5556cbbfd4b00aa4f6055cd6238b2 Aug 10 13:44:09.801048 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:44:09.801048 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User: tempest-AttachVolumeNegativeTest-965925392-project Aug 10 13:44:09.801048 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Id: default Aug 10 13:44:09.801048 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Name: Default Aug 10 13:44:09.801048 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Id: a3d9e5dc719c430eac6b5c8d8b814566 Aug 10 13:44:09.801048 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Name: tempest-AttachVolumeNegativeTest-965925392-project Aug 10 13:44:09.801048 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: method: > Aug 10 13:44:09.801048 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: exception: Instance 59cf654d-76ac-488e-93ff-ccb46e164602 could not be found. Aug 10 13:44:09.801048 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: action_args: {'id': '59cf654d-76ac-488e-93ff-ccb46e164602'} Aug 10 13:44:09.801992 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:44:09.801992 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:09.801992 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:44:09.801992 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:44:09.801992 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:44:09.801992 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:44:09.801992 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:44:09.801992 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:44:09.801992 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:44:09.801992 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:44:09.801992 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59cf654d-76ac-488e-93ff-ccb46e164602 could not be found. Aug 10 13:44:09.801992 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:44:09.801992 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:44:09.801992 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:44:09.801992 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:09.801992 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:44:09.801992 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:44:09.801992 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:44:09.801992 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:44:09.801992 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:44:09.803331 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:44:09.803331 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:44:09.803331 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:44:09.803331 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:44:09.803331 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:44:09.803331 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:44:09.803331 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:44:09.803331 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59cf654d-76ac-488e-93ff-ccb46e164602 could not be found. Aug 10 13:44:09.803331 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:44:09.803331 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:44:09.803331 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:44:09.803331 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:09.803331 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:44:09.803331 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:44:09.803331 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:44:09.803331 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:44:09.803331 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59cf654d-76ac-488e-93ff-ccb46e164602 could not be found. Aug 10 13:44:09.803331 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:44:09.804455 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-c67ac4bf-eaa2-47e0-9898-2e53af8012ff tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Returning 404 to user: Instance 59cf654d-76ac-488e-93ff-ccb46e164602 could not be found. {{(pid=129522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:44:09.804455 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-c67ac4bf-eaa2-47e0-9898-2e53af8012ff tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602" status: 404 len: 111 microversion: 2.1 time: 0.033972 Aug 10 13:44:09.804455 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 432/833] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:44:09 2022] GET /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:44:09.814947 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-d44b6ccd-594f-4178-b39d-2ed698c47c37 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '.version_select at 0x7f49c44785e0>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:09.841476 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-d44b6ccd-594f-4178-b39d-2ed698c47c37 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2105523620" status: 202 len: 0 microversion: 2.1 time: 0.034340 Aug 10 13:44:09.842525 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 402/834] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Aug 10 13:44:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2105523620 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:44:11.600118 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-7b11657c-6349-47d2-9d99-b61bc1d9c2c7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:11.600628 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-7b11657c-6349-47d2-9d99-b61bc1d9c2c7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 59cf654d-76ac-488e-93ff-ccb46e164602] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:11.607196 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7b11657c-6349-47d2-9d99-b61bc1d9c2c7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:11.607676 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7b11657c-6349-47d2-9d99-b61bc1d9c2c7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:11.608109 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7b11657c-6349-47d2-9d99-b61bc1d9c2c7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:11.608790 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7b11657c-6349-47d2-9d99-b61bc1d9c2c7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:11.609246 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7b11657c-6349-47d2-9d99-b61bc1d9c2c7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:11.609676 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-7b11657c-6349-47d2-9d99-b61bc1d9c2c7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:11.623268 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.wsgi [None req-7b11657c-6349-47d2-9d99-b61bc1d9c2c7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] HTTP exception thrown: Instance 59cf654d-76ac-488e-93ff-ccb46e164602 could not be found. Aug 10 13:44:11.624801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-7b11657c-6349-47d2-9d99-b61bc1d9c2c7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Request method failure captured: Aug 10 13:44:11.624801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: request: DELETE /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602 HTTP/1.1 Aug 10 13:44:11.624801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept: application/json Aug 10 13:44:11.624801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept-Encoding: identity Aug 10 13:44:11.624801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Connection: close Aug 10 13:44:11.624801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Length: 0 Aug 10 13:44:11.624801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Type: application/json Aug 10 13:44:11.624801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Host: 10.222.0.52 Aug 10 13:44:11.624801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Openstack-System-Scope: None Aug 10 13:44:11.624801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: User-Agent: python-urllib3/1.26.11 Aug 10 13:44:11.624801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Auth-Token: gAAAAABi87Sor1QukN8WwkCMRH0utTzHqdtW9hBypcULvW8_thEN8NIRbRb3dRFY62pVCieUmq7t4p3U1aqc6NH3mLhkTq5eSrbHxF5HfdCRrvoVeQ0o3DpawgBQQZEUeD2RccyRTg2LrZLPb9H0A6tO9wPr-HvRM84fUPq4D0GzK22Ap72p14g Aug 10 13:44:11.624801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Id: None Aug 10 13:44:11.624801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Name: None Aug 10 13:44:11.624801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Identity-Status: Confirmed Aug 10 13:44:11.624801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Is-Admin-Project: True Aug 10 13:44:11.624801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Id: default Aug 10 13:44:11.624801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Name: Default Aug 10 13:44:11.624801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Id: 48e5556cbbfd4b00aa4f6055cd6238b2 Aug 10 13:44:11.624801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Name: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:44:11.624801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Role: member,reader Aug 10 13:44:11.624801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Roles: member,reader Aug 10 13:44:11.626144 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/48e5556cbbfd4b00aa4f6055cd6238b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48e5556cbbfd4b00aa4f6055cd6238b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_48e5556cbbfd4b00aa4f6055cd6238b2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48e5556cbbfd4b00aa4f6055cd6238b2"}]}] Aug 10 13:44:11.626144 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:44:11.626144 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Id: 48e5556cbbfd4b00aa4f6055cd6238b2 Aug 10 13:44:11.626144 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:44:11.626144 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User: tempest-AttachVolumeNegativeTest-965925392-project Aug 10 13:44:11.626144 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Id: default Aug 10 13:44:11.626144 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Name: Default Aug 10 13:44:11.626144 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Id: a3d9e5dc719c430eac6b5c8d8b814566 Aug 10 13:44:11.626144 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Name: tempest-AttachVolumeNegativeTest-965925392-project Aug 10 13:44:11.626144 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: method: > Aug 10 13:44:11.626144 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: exception: Instance 59cf654d-76ac-488e-93ff-ccb46e164602 could not be found. Aug 10 13:44:11.626144 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: action_args: {'id': '59cf654d-76ac-488e-93ff-ccb46e164602'} Aug 10 13:44:11.627528 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:44:11.627528 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:11.627528 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:44:11.627528 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:44:11.627528 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:44:11.627528 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:44:11.627528 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:44:11.627528 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:44:11.627528 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:44:11.627528 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:44:11.627528 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59cf654d-76ac-488e-93ff-ccb46e164602 could not be found. Aug 10 13:44:11.627528 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:44:11.627528 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:44:11.627528 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:44:11.627528 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:11.627528 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:44:11.627528 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:44:11.627528 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:44:11.627528 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:44:11.627528 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:44:11.628755 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:44:11.628755 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 13:44:11.628755 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 13:44:11.628755 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 13:44:11.628755 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 13:44:11.628755 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:44:11.628755 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:44:11.628755 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:44:11.628755 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:44:11.628755 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59cf654d-76ac-488e-93ff-ccb46e164602 could not be found. Aug 10 13:44:11.628755 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:44:11.628755 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:44:11.628755 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:44:11.628755 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:11.628755 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:44:11.628755 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:44:11.628755 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:44:11.628755 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:44:11.628755 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59cf654d-76ac-488e-93ff-ccb46e164602 could not be found. Aug 10 13:44:11.628755 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:44:11.631139 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-7b11657c-6349-47d2-9d99-b61bc1d9c2c7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Returning 404 to user: Instance 59cf654d-76ac-488e-93ff-ccb46e164602 could not be found. {{(pid=129522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:44:11.631139 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-7b11657c-6349-47d2-9d99-b61bc1d9c2c7 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "DELETE /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602" status: 404 len: 111 microversion: 2.1 time: 0.030042 Aug 10 13:44:11.631139 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 433/835] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 10 13:44:11 2022] DELETE /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:44:11.641472 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-755b0d6d-bca9-4ebc-9642-6b28cc041c6a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:11.641472 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-755b0d6d-bca9-4ebc-9642-6b28cc041c6a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 59cf654d-76ac-488e-93ff-ccb46e164602] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:11.644816 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-755b0d6d-bca9-4ebc-9642-6b28cc041c6a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:11.645493 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-755b0d6d-bca9-4ebc-9642-6b28cc041c6a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:11.646247 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-755b0d6d-bca9-4ebc-9642-6b28cc041c6a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:11.647375 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-755b0d6d-bca9-4ebc-9642-6b28cc041c6a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:11.648008 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-755b0d6d-bca9-4ebc-9642-6b28cc041c6a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:11.648911 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-755b0d6d-bca9-4ebc-9642-6b28cc041c6a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:11.665161 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.wsgi [None req-755b0d6d-bca9-4ebc-9642-6b28cc041c6a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] HTTP exception thrown: Instance 59cf654d-76ac-488e-93ff-ccb46e164602 could not be found. Aug 10 13:44:11.667392 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-755b0d6d-bca9-4ebc-9642-6b28cc041c6a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Request method failure captured: Aug 10 13:44:11.667392 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: request: GET /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602 HTTP/1.1 Aug 10 13:44:11.667392 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept: application/json Aug 10 13:44:11.667392 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept-Encoding: identity Aug 10 13:44:11.667392 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Connection: close Aug 10 13:44:11.667392 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Length: 0 Aug 10 13:44:11.667392 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Type: application/json Aug 10 13:44:11.667392 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Host: 10.222.0.52 Aug 10 13:44:11.667392 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Openstack-System-Scope: None Aug 10 13:44:11.667392 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: User-Agent: python-urllib3/1.26.11 Aug 10 13:44:11.667392 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Auth-Token: gAAAAABi87Sor1QukN8WwkCMRH0utTzHqdtW9hBypcULvW8_thEN8NIRbRb3dRFY62pVCieUmq7t4p3U1aqc6NH3mLhkTq5eSrbHxF5HfdCRrvoVeQ0o3DpawgBQQZEUeD2RccyRTg2LrZLPb9H0A6tO9wPr-HvRM84fUPq4D0GzK22Ap72p14g Aug 10 13:44:11.667392 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Id: None Aug 10 13:44:11.667392 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Name: None Aug 10 13:44:11.667392 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Identity-Status: Confirmed Aug 10 13:44:11.667392 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Is-Admin-Project: True Aug 10 13:44:11.667392 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Id: default Aug 10 13:44:11.667392 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Name: Default Aug 10 13:44:11.667392 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Id: 48e5556cbbfd4b00aa4f6055cd6238b2 Aug 10 13:44:11.667392 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Name: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:44:11.667392 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Role: member,reader Aug 10 13:44:11.667392 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Roles: member,reader Aug 10 13:44:11.669532 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/48e5556cbbfd4b00aa4f6055cd6238b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48e5556cbbfd4b00aa4f6055cd6238b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_48e5556cbbfd4b00aa4f6055cd6238b2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48e5556cbbfd4b00aa4f6055cd6238b2"}]}] Aug 10 13:44:11.669532 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:44:11.669532 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Id: 48e5556cbbfd4b00aa4f6055cd6238b2 Aug 10 13:44:11.669532 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:44:11.669532 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User: tempest-AttachVolumeNegativeTest-965925392-project Aug 10 13:44:11.669532 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Id: default Aug 10 13:44:11.669532 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Name: Default Aug 10 13:44:11.669532 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Id: a3d9e5dc719c430eac6b5c8d8b814566 Aug 10 13:44:11.669532 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Name: tempest-AttachVolumeNegativeTest-965925392-project Aug 10 13:44:11.669532 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: method: > Aug 10 13:44:11.669532 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: exception: Instance 59cf654d-76ac-488e-93ff-ccb46e164602 could not be found. Aug 10 13:44:11.669532 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: action_args: {'id': '59cf654d-76ac-488e-93ff-ccb46e164602'} Aug 10 13:44:11.670503 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:44:11.670503 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:11.670503 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:44:11.670503 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:44:11.670503 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:44:11.670503 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:44:11.670503 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:44:11.670503 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:44:11.670503 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:44:11.670503 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:44:11.670503 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59cf654d-76ac-488e-93ff-ccb46e164602 could not be found. Aug 10 13:44:11.670503 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:11.670503 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:44:11.670503 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:11.670503 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:11.670503 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:44:11.670503 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:44:11.670503 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:44:11.670503 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:44:11.670503 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:44:11.671719 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:44:11.671719 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:44:11.671719 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:44:11.671719 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:44:11.671719 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:44:11.671719 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:44:11.671719 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:44:11.671719 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59cf654d-76ac-488e-93ff-ccb46e164602 could not be found. Aug 10 13:44:11.671719 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:11.671719 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:44:11.671719 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:11.671719 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:11.671719 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:44:11.671719 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:44:11.671719 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:44:11.671719 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:44:11.671719 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59cf654d-76ac-488e-93ff-ccb46e164602 could not be found. Aug 10 13:44:11.671719 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:11.674106 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-755b0d6d-bca9-4ebc-9642-6b28cc041c6a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Returning 404 to user: Instance 59cf654d-76ac-488e-93ff-ccb46e164602 could not be found. {{(pid=129523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:44:11.675135 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-755b0d6d-bca9-4ebc-9642-6b28cc041c6a tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602" status: 404 len: 111 microversion: 2.1 time: 0.044274 Aug 10 13:44:11.679492 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 403/836] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:44:11 2022] GET /compute/v2.1/servers/59cf654d-76ac-488e-93ff-ccb46e164602 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:44:12.582827 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-aeae7a30-eeda-4e77-b649-ef1e536a93f3 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:12.585218 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-aeae7a30-eeda-4e77-b649-ef1e536a93f3 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 3d30c2bb-a513-4a88-a9e4-3cf892bda262] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:12.591779 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-aeae7a30-eeda-4e77-b649-ef1e536a93f3 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:12.592261 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-aeae7a30-eeda-4e77-b649-ef1e536a93f3 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:12.592697 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-aeae7a30-eeda-4e77-b649-ef1e536a93f3 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:12.593831 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-aeae7a30-eeda-4e77-b649-ef1e536a93f3 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:12.594313 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-aeae7a30-eeda-4e77-b649-ef1e536a93f3 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:12.594748 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-aeae7a30-eeda-4e77-b649-ef1e536a93f3 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:12.626616 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-aeae7a30-eeda-4e77-b649-ef1e536a93f3 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047642 Aug 10 13:44:12.627454 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 434/837] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 10 13:44:12 2022] GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:44:12.637732 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-661ce1f7-644b-4be9-9a3f-0b1e8baf0380 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:12.638224 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-661ce1f7-644b-4be9-9a3f-0b1e8baf0380 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 3d30c2bb-a513-4a88-a9e4-3cf892bda262] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:12.644528 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-661ce1f7-644b-4be9-9a3f-0b1e8baf0380 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:12.645140 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-661ce1f7-644b-4be9-9a3f-0b1e8baf0380 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:12.645468 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-661ce1f7-644b-4be9-9a3f-0b1e8baf0380 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:12.646158 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-661ce1f7-644b-4be9-9a3f-0b1e8baf0380 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:12.646605 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-661ce1f7-644b-4be9-9a3f-0b1e8baf0380 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:12.647022 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-661ce1f7-644b-4be9-9a3f-0b1e8baf0380 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:12.677071 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-661ce1f7-644b-4be9-9a3f-0b1e8baf0380 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262/os-volume_attachments/5a1ec6ef-5989-47c4-b666-51d800ed75f0" status: 200 len: 194 microversion: 2.1 time: 0.043192 Aug 10 13:44:12.677718 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 404/838] 10.222.0.52 () {58 vars in 1413 bytes} [Wed Aug 10 13:44:12 2022] GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262/os-volume_attachments/5a1ec6ef-5989-47c4-b666-51d800ed75f0 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:44:12.843774 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-93a174ad-28d7-43ce-9353-d66287956b0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:12.844364 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-93a174ad-28d7-43ce-9353-d66287956b0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: bfb52e6c-577e-4368-a03e-1be5e40b8e43] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:12.852575 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-93a174ad-28d7-43ce-9353-d66287956b0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:12.853055 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-93a174ad-28d7-43ce-9353-d66287956b0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:12.853514 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-93a174ad-28d7-43ce-9353-d66287956b0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:12.854203 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-93a174ad-28d7-43ce-9353-d66287956b0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:12.854653 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-93a174ad-28d7-43ce-9353-d66287956b0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:12.855201 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-93a174ad-28d7-43ce-9353-d66287956b0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:12.873786 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.wsgi [None req-93a174ad-28d7-43ce-9353-d66287956b0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] HTTP exception thrown: Instance bfb52e6c-577e-4368-a03e-1be5e40b8e43 could not be found. Aug 10 13:44:12.875537 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-93a174ad-28d7-43ce-9353-d66287956b0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Request method failure captured: Aug 10 13:44:12.875537 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: request: DELETE /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43 HTTP/1.1 Aug 10 13:44:12.875537 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept: application/json Aug 10 13:44:12.875537 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept-Encoding: identity Aug 10 13:44:12.875537 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Connection: close Aug 10 13:44:12.875537 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Length: 0 Aug 10 13:44:12.875537 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Type: application/json Aug 10 13:44:12.875537 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Host: 10.222.0.52 Aug 10 13:44:12.875537 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Openstack-System-Scope: None Aug 10 13:44:12.875537 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: User-Agent: python-urllib3/1.26.11 Aug 10 13:44:12.875537 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Auth-Token: gAAAAABi87Sor1QukN8WwkCMRH0utTzHqdtW9hBypcULvW8_thEN8NIRbRb3dRFY62pVCieUmq7t4p3U1aqc6NH3mLhkTq5eSrbHxF5HfdCRrvoVeQ0o3DpawgBQQZEUeD2RccyRTg2LrZLPb9H0A6tO9wPr-HvRM84fUPq4D0GzK22Ap72p14g Aug 10 13:44:12.875537 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Id: None Aug 10 13:44:12.875537 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Name: None Aug 10 13:44:12.875537 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Identity-Status: Confirmed Aug 10 13:44:12.875537 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Is-Admin-Project: True Aug 10 13:44:12.875537 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Id: default Aug 10 13:44:12.875537 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Name: Default Aug 10 13:44:12.875537 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Id: 48e5556cbbfd4b00aa4f6055cd6238b2 Aug 10 13:44:12.875537 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Name: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:44:12.875537 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Role: member,reader Aug 10 13:44:12.875537 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Roles: member,reader Aug 10 13:44:12.876984 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/48e5556cbbfd4b00aa4f6055cd6238b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48e5556cbbfd4b00aa4f6055cd6238b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_48e5556cbbfd4b00aa4f6055cd6238b2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48e5556cbbfd4b00aa4f6055cd6238b2"}]}] Aug 10 13:44:12.876984 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:44:12.876984 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Id: 48e5556cbbfd4b00aa4f6055cd6238b2 Aug 10 13:44:12.876984 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:44:12.876984 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User: tempest-AttachVolumeNegativeTest-965925392-project Aug 10 13:44:12.876984 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Id: default Aug 10 13:44:12.876984 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Name: Default Aug 10 13:44:12.876984 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Id: a3d9e5dc719c430eac6b5c8d8b814566 Aug 10 13:44:12.876984 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Name: tempest-AttachVolumeNegativeTest-965925392-project Aug 10 13:44:12.876984 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: method: > Aug 10 13:44:12.876984 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: exception: Instance bfb52e6c-577e-4368-a03e-1be5e40b8e43 could not be found. Aug 10 13:44:12.876984 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: action_args: {'id': 'bfb52e6c-577e-4368-a03e-1be5e40b8e43'} Aug 10 13:44:12.878270 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:44:12.878270 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:12.878270 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:44:12.878270 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:44:12.878270 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:44:12.878270 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:44:12.878270 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:44:12.878270 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:44:12.878270 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:44:12.878270 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:44:12.878270 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfb52e6c-577e-4368-a03e-1be5e40b8e43 could not be found. Aug 10 13:44:12.878270 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:44:12.878270 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:44:12.878270 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:44:12.878270 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:12.878270 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:44:12.878270 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:44:12.878270 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:44:12.878270 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:44:12.878270 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:44:12.880407 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:44:12.880407 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 13:44:12.880407 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 13:44:12.880407 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 13:44:12.880407 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 13:44:12.880407 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:44:12.880407 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:44:12.880407 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:44:12.880407 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:44:12.880407 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfb52e6c-577e-4368-a03e-1be5e40b8e43 could not be found. Aug 10 13:44:12.880407 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:44:12.880407 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:44:12.880407 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:44:12.880407 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:12.880407 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:44:12.880407 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:44:12.880407 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:44:12.880407 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:44:12.880407 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfb52e6c-577e-4368-a03e-1be5e40b8e43 could not be found. Aug 10 13:44:12.880407 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:44:12.882599 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-93a174ad-28d7-43ce-9353-d66287956b0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Returning 404 to user: Instance bfb52e6c-577e-4368-a03e-1be5e40b8e43 could not be found. {{(pid=129522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:44:12.882599 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-93a174ad-28d7-43ce-9353-d66287956b0f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43" status: 404 len: 111 microversion: 2.1 time: 0.040447 Aug 10 13:44:12.882599 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 435/839] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 10 13:44:12 2022] DELETE /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:44:12.897641 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-7826d7b6-8385-4b07-b1ee-926ce9eaf53f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:12.897641 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-7826d7b6-8385-4b07-b1ee-926ce9eaf53f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: bfb52e6c-577e-4368-a03e-1be5e40b8e43] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:12.897641 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7826d7b6-8385-4b07-b1ee-926ce9eaf53f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:12.897641 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7826d7b6-8385-4b07-b1ee-926ce9eaf53f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:12.898156 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7826d7b6-8385-4b07-b1ee-926ce9eaf53f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:12.898156 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7826d7b6-8385-4b07-b1ee-926ce9eaf53f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:12.898156 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7826d7b6-8385-4b07-b1ee-926ce9eaf53f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:12.898493 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7826d7b6-8385-4b07-b1ee-926ce9eaf53f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:12.923583 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.wsgi [None req-7826d7b6-8385-4b07-b1ee-926ce9eaf53f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] HTTP exception thrown: Instance bfb52e6c-577e-4368-a03e-1be5e40b8e43 could not be found. Aug 10 13:44:12.925220 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-7826d7b6-8385-4b07-b1ee-926ce9eaf53f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Request method failure captured: Aug 10 13:44:12.925220 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: request: GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43 HTTP/1.1 Aug 10 13:44:12.925220 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept: application/json Aug 10 13:44:12.925220 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept-Encoding: identity Aug 10 13:44:12.925220 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Connection: close Aug 10 13:44:12.925220 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Length: 0 Aug 10 13:44:12.925220 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Type: application/json Aug 10 13:44:12.925220 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Host: 10.222.0.52 Aug 10 13:44:12.925220 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Openstack-System-Scope: None Aug 10 13:44:12.925220 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: User-Agent: python-urllib3/1.26.11 Aug 10 13:44:12.925220 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Auth-Token: gAAAAABi87Sor1QukN8WwkCMRH0utTzHqdtW9hBypcULvW8_thEN8NIRbRb3dRFY62pVCieUmq7t4p3U1aqc6NH3mLhkTq5eSrbHxF5HfdCRrvoVeQ0o3DpawgBQQZEUeD2RccyRTg2LrZLPb9H0A6tO9wPr-HvRM84fUPq4D0GzK22Ap72p14g Aug 10 13:44:12.925220 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Id: None Aug 10 13:44:12.925220 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Name: None Aug 10 13:44:12.925220 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Identity-Status: Confirmed Aug 10 13:44:12.925220 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Is-Admin-Project: True Aug 10 13:44:12.925220 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Id: default Aug 10 13:44:12.925220 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Name: Default Aug 10 13:44:12.925220 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Id: 48e5556cbbfd4b00aa4f6055cd6238b2 Aug 10 13:44:12.925220 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Name: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:44:12.925220 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Role: member,reader Aug 10 13:44:12.925220 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Roles: member,reader Aug 10 13:44:12.926585 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/48e5556cbbfd4b00aa4f6055cd6238b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48e5556cbbfd4b00aa4f6055cd6238b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_48e5556cbbfd4b00aa4f6055cd6238b2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48e5556cbbfd4b00aa4f6055cd6238b2"}]}] Aug 10 13:44:12.926585 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:44:12.926585 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Id: 48e5556cbbfd4b00aa4f6055cd6238b2 Aug 10 13:44:12.926585 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:44:12.926585 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User: tempest-AttachVolumeNegativeTest-965925392-project Aug 10 13:44:12.926585 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Id: default Aug 10 13:44:12.926585 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Name: Default Aug 10 13:44:12.926585 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Id: a3d9e5dc719c430eac6b5c8d8b814566 Aug 10 13:44:12.926585 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Name: tempest-AttachVolumeNegativeTest-965925392-project Aug 10 13:44:12.926585 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: method: > Aug 10 13:44:12.926585 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: exception: Instance bfb52e6c-577e-4368-a03e-1be5e40b8e43 could not be found. Aug 10 13:44:12.926585 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: action_args: {'id': 'bfb52e6c-577e-4368-a03e-1be5e40b8e43'} Aug 10 13:44:12.927358 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:44:12.927358 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:12.927358 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:44:12.927358 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:44:12.927358 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:44:12.927358 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:44:12.927358 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:44:12.927358 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:44:12.927358 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:44:12.927358 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:44:12.927358 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfb52e6c-577e-4368-a03e-1be5e40b8e43 could not be found. Aug 10 13:44:12.927358 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:12.927358 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:44:12.927358 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:12.927358 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:12.927358 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:44:12.927358 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:44:12.927358 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:44:12.927358 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:44:12.927358 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:44:12.928536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:44:12.928536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:44:12.928536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:44:12.928536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:44:12.928536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:44:12.928536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:44:12.928536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:44:12.928536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfb52e6c-577e-4368-a03e-1be5e40b8e43 could not be found. Aug 10 13:44:12.928536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:12.928536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:44:12.928536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:12.928536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:12.928536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:44:12.928536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:44:12.928536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:44:12.928536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:44:12.928536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfb52e6c-577e-4368-a03e-1be5e40b8e43 could not be found. Aug 10 13:44:12.928536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:12.931178 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-7826d7b6-8385-4b07-b1ee-926ce9eaf53f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Returning 404 to user: Instance bfb52e6c-577e-4368-a03e-1be5e40b8e43 could not be found. {{(pid=129523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:44:12.931178 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-7826d7b6-8385-4b07-b1ee-926ce9eaf53f tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43" status: 404 len: 111 microversion: 2.1 time: 0.042442 Aug 10 13:44:12.931178 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 405/840] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:44:12 2022] GET /compute/v2.1/servers/bfb52e6c-577e-4368-a03e-1be5e40b8e43 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:44:12.938695 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-977e9b5f-17f6-40d8-bb78-6addf07ede3c tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:12.939218 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-977e9b5f-17f6-40d8-bb78-6addf07ede3c tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 0d6055de-aea1-4e3b-9016-4c25dca9f779] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:12.945652 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-977e9b5f-17f6-40d8-bb78-6addf07ede3c tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:12.946139 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-977e9b5f-17f6-40d8-bb78-6addf07ede3c tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:12.946574 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-977e9b5f-17f6-40d8-bb78-6addf07ede3c tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:12.947272 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-977e9b5f-17f6-40d8-bb78-6addf07ede3c tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:12.947720 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-977e9b5f-17f6-40d8-bb78-6addf07ede3c tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:12.948140 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-977e9b5f-17f6-40d8-bb78-6addf07ede3c tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:12.980359 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.wsgi [None req-977e9b5f-17f6-40d8-bb78-6addf07ede3c tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] HTTP exception thrown: Instance 0d6055de-aea1-4e3b-9016-4c25dca9f779 could not be found. Aug 10 13:44:12.982538 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-977e9b5f-17f6-40d8-bb78-6addf07ede3c tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Request method failure captured: Aug 10 13:44:12.982538 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: request: DELETE /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779 HTTP/1.1 Aug 10 13:44:12.982538 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept: application/json Aug 10 13:44:12.982538 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept-Encoding: identity Aug 10 13:44:12.982538 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Connection: close Aug 10 13:44:12.982538 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Length: 0 Aug 10 13:44:12.982538 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Type: application/json Aug 10 13:44:12.982538 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Host: 10.222.0.52 Aug 10 13:44:12.982538 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Openstack-System-Scope: None Aug 10 13:44:12.982538 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: User-Agent: python-urllib3/1.26.11 Aug 10 13:44:12.982538 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Auth-Token: gAAAAABi87Sor1QukN8WwkCMRH0utTzHqdtW9hBypcULvW8_thEN8NIRbRb3dRFY62pVCieUmq7t4p3U1aqc6NH3mLhkTq5eSrbHxF5HfdCRrvoVeQ0o3DpawgBQQZEUeD2RccyRTg2LrZLPb9H0A6tO9wPr-HvRM84fUPq4D0GzK22Ap72p14g Aug 10 13:44:12.982538 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Id: None Aug 10 13:44:12.982538 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Name: None Aug 10 13:44:12.982538 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Identity-Status: Confirmed Aug 10 13:44:12.982538 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Is-Admin-Project: True Aug 10 13:44:12.982538 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Id: default Aug 10 13:44:12.982538 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Name: Default Aug 10 13:44:12.982538 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Id: 48e5556cbbfd4b00aa4f6055cd6238b2 Aug 10 13:44:12.982538 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Name: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:44:12.982538 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Role: member,reader Aug 10 13:44:12.982538 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Roles: member,reader Aug 10 13:44:12.983914 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/48e5556cbbfd4b00aa4f6055cd6238b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48e5556cbbfd4b00aa4f6055cd6238b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_48e5556cbbfd4b00aa4f6055cd6238b2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48e5556cbbfd4b00aa4f6055cd6238b2"}]}] Aug 10 13:44:12.983914 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:44:12.983914 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Id: 48e5556cbbfd4b00aa4f6055cd6238b2 Aug 10 13:44:12.983914 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:44:12.983914 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User: tempest-AttachVolumeNegativeTest-965925392-project Aug 10 13:44:12.983914 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Id: default Aug 10 13:44:12.983914 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Name: Default Aug 10 13:44:12.983914 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Id: a3d9e5dc719c430eac6b5c8d8b814566 Aug 10 13:44:12.983914 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Name: tempest-AttachVolumeNegativeTest-965925392-project Aug 10 13:44:12.983914 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: method: > Aug 10 13:44:12.983914 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: exception: Instance 0d6055de-aea1-4e3b-9016-4c25dca9f779 could not be found. Aug 10 13:44:12.983914 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: action_args: {'id': '0d6055de-aea1-4e3b-9016-4c25dca9f779'} Aug 10 13:44:12.984649 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:44:12.984649 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:12.984649 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:44:12.984649 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:44:12.984649 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:44:12.984649 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:44:12.984649 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:44:12.984649 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:44:12.984649 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:44:12.984649 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:44:12.984649 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d6055de-aea1-4e3b-9016-4c25dca9f779 could not be found. Aug 10 13:44:12.984649 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:44:12.984649 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:44:12.984649 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:44:12.984649 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:12.984649 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:44:12.984649 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:44:12.984649 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:44:12.984649 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:44:12.984649 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:44:12.988314 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:44:12.988314 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 13:44:12.988314 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 13:44:12.988314 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 13:44:12.988314 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 13:44:12.988314 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:44:12.988314 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:44:12.988314 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:44:12.988314 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:44:12.988314 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d6055de-aea1-4e3b-9016-4c25dca9f779 could not be found. Aug 10 13:44:12.988314 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:44:12.988314 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:44:12.988314 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:44:12.988314 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:12.988314 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:44:12.988314 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:44:12.988314 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:44:12.988314 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:44:12.988314 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d6055de-aea1-4e3b-9016-4c25dca9f779 could not be found. Aug 10 13:44:12.988314 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:44:12.990330 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-977e9b5f-17f6-40d8-bb78-6addf07ede3c tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Returning 404 to user: Instance 0d6055de-aea1-4e3b-9016-4c25dca9f779 could not be found. {{(pid=129522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:44:12.990330 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-977e9b5f-17f6-40d8-bb78-6addf07ede3c tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779" status: 404 len: 111 microversion: 2.1 time: 0.050697 Aug 10 13:44:12.990330 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 436/841] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 10 13:44:12 2022] DELETE /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:44:12.992838 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-1d6362c9-e71a-4003-ad58-e653425baa7c tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:12.993567 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-1d6362c9-e71a-4003-ad58-e653425baa7c tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 0d6055de-aea1-4e3b-9016-4c25dca9f779] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:13.002786 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1d6362c9-e71a-4003-ad58-e653425baa7c tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:13.003708 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1d6362c9-e71a-4003-ad58-e653425baa7c tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:13.004547 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1d6362c9-e71a-4003-ad58-e653425baa7c tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:13.005975 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1d6362c9-e71a-4003-ad58-e653425baa7c tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:13.006729 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1d6362c9-e71a-4003-ad58-e653425baa7c tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:13.007327 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1d6362c9-e71a-4003-ad58-e653425baa7c tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:13.022997 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.wsgi [None req-1d6362c9-e71a-4003-ad58-e653425baa7c tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] HTTP exception thrown: Instance 0d6055de-aea1-4e3b-9016-4c25dca9f779 could not be found. Aug 10 13:44:13.025018 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-1d6362c9-e71a-4003-ad58-e653425baa7c tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Request method failure captured: Aug 10 13:44:13.025018 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: request: GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779 HTTP/1.1 Aug 10 13:44:13.025018 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept: application/json Aug 10 13:44:13.025018 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept-Encoding: identity Aug 10 13:44:13.025018 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Connection: close Aug 10 13:44:13.025018 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Length: 0 Aug 10 13:44:13.025018 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Type: application/json Aug 10 13:44:13.025018 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Host: 10.222.0.52 Aug 10 13:44:13.025018 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Openstack-System-Scope: None Aug 10 13:44:13.025018 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: User-Agent: python-urllib3/1.26.11 Aug 10 13:44:13.025018 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Auth-Token: gAAAAABi87Sor1QukN8WwkCMRH0utTzHqdtW9hBypcULvW8_thEN8NIRbRb3dRFY62pVCieUmq7t4p3U1aqc6NH3mLhkTq5eSrbHxF5HfdCRrvoVeQ0o3DpawgBQQZEUeD2RccyRTg2LrZLPb9H0A6tO9wPr-HvRM84fUPq4D0GzK22Ap72p14g Aug 10 13:44:13.025018 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Id: None Aug 10 13:44:13.025018 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Name: None Aug 10 13:44:13.025018 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Identity-Status: Confirmed Aug 10 13:44:13.025018 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Is-Admin-Project: True Aug 10 13:44:13.025018 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Id: default Aug 10 13:44:13.025018 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Name: Default Aug 10 13:44:13.025018 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Id: 48e5556cbbfd4b00aa4f6055cd6238b2 Aug 10 13:44:13.025018 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Name: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:44:13.025018 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Role: member,reader Aug 10 13:44:13.025018 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Roles: member,reader Aug 10 13:44:13.026392 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/48e5556cbbfd4b00aa4f6055cd6238b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48e5556cbbfd4b00aa4f6055cd6238b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_48e5556cbbfd4b00aa4f6055cd6238b2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48e5556cbbfd4b00aa4f6055cd6238b2"}]}] Aug 10 13:44:13.026392 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:44:13.026392 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Id: 48e5556cbbfd4b00aa4f6055cd6238b2 Aug 10 13:44:13.026392 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:44:13.026392 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User: tempest-AttachVolumeNegativeTest-965925392-project Aug 10 13:44:13.026392 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Id: default Aug 10 13:44:13.026392 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Name: Default Aug 10 13:44:13.026392 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Id: a3d9e5dc719c430eac6b5c8d8b814566 Aug 10 13:44:13.026392 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Name: tempest-AttachVolumeNegativeTest-965925392-project Aug 10 13:44:13.026392 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: method: > Aug 10 13:44:13.026392 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: exception: Instance 0d6055de-aea1-4e3b-9016-4c25dca9f779 could not be found. Aug 10 13:44:13.026392 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: action_args: {'id': '0d6055de-aea1-4e3b-9016-4c25dca9f779'} Aug 10 13:44:13.027200 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:44:13.027200 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:13.027200 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:44:13.027200 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:44:13.027200 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:44:13.027200 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:44:13.027200 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:44:13.027200 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:44:13.027200 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:44:13.027200 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:44:13.027200 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d6055de-aea1-4e3b-9016-4c25dca9f779 could not be found. Aug 10 13:44:13.027200 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:13.027200 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:44:13.027200 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:13.027200 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:13.027200 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:44:13.027200 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:44:13.027200 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:44:13.027200 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:44:13.027200 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:44:13.028485 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:44:13.028485 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:44:13.028485 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:44:13.028485 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:44:13.028485 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:44:13.028485 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:44:13.028485 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:44:13.028485 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d6055de-aea1-4e3b-9016-4c25dca9f779 could not be found. Aug 10 13:44:13.028485 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:13.028485 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:44:13.028485 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:13.028485 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:13.028485 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:44:13.028485 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:44:13.028485 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:44:13.028485 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:44:13.028485 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d6055de-aea1-4e3b-9016-4c25dca9f779 could not be found. Aug 10 13:44:13.028485 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:13.041846 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-1d6362c9-e71a-4003-ad58-e653425baa7c tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Returning 404 to user: Instance 0d6055de-aea1-4e3b-9016-4c25dca9f779 could not be found. {{(pid=129523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:44:13.041846 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-1d6362c9-e71a-4003-ad58-e653425baa7c tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779" status: 404 len: 111 microversion: 2.1 time: 0.045936 Aug 10 13:44:13.041846 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 406/842] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:44:12 2022] GET /compute/v2.1/servers/0d6055de-aea1-4e3b-9016-4c25dca9f779 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:44:16.221377 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-d594e74e-47d0-4f41-8e21-7272695bc3ab tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d223b467-800f-47c4-870e-4eaf418e0047"}} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:44:16.223824 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-d594e74e-47d0-4f41-8e21-7272695bc3ab tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 3d30c2bb-a513-4a88-a9e4-3cf892bda262] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:16.235786 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d594e74e-47d0-4f41-8e21-7272695bc3ab tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:16.236336 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d594e74e-47d0-4f41-8e21-7272695bc3ab tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:16.236770 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d594e74e-47d0-4f41-8e21-7272695bc3ab tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:16.237507 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d594e74e-47d0-4f41-8e21-7272695bc3ab tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:16.238212 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d594e74e-47d0-4f41-8e21-7272695bc3ab tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:16.238696 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d594e74e-47d0-4f41-8e21-7272695bc3ab tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:16.291247 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-7df096a7-86b5-4ad4-a513-f39638392b71 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:16.292693 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-7df096a7-86b5-4ad4-a513-f39638392b71 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 41baab24-f648-4e7d-83bb-4357214ea438] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:16.311870 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7df096a7-86b5-4ad4-a513-f39638392b71 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:16.318549 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7df096a7-86b5-4ad4-a513-f39638392b71 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:16.319126 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7df096a7-86b5-4ad4-a513-f39638392b71 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:16.320005 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7df096a7-86b5-4ad4-a513-f39638392b71 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:16.320547 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7df096a7-86b5-4ad4-a513-f39638392b71 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:16.321060 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7df096a7-86b5-4ad4-a513-f39638392b71 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:16.342140 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.wsgi [None req-7df096a7-86b5-4ad4-a513-f39638392b71 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] HTTP exception thrown: Instance 41baab24-f648-4e7d-83bb-4357214ea438 could not be found. Aug 10 13:44:16.343757 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-7df096a7-86b5-4ad4-a513-f39638392b71 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Request method failure captured: Aug 10 13:44:16.343757 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: request: DELETE /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438 HTTP/1.1 Aug 10 13:44:16.343757 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept: application/json Aug 10 13:44:16.343757 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept-Encoding: identity Aug 10 13:44:16.343757 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Connection: close Aug 10 13:44:16.343757 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Length: 0 Aug 10 13:44:16.343757 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Type: application/json Aug 10 13:44:16.343757 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Host: 10.222.0.52 Aug 10 13:44:16.343757 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Openstack-System-Scope: None Aug 10 13:44:16.343757 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: User-Agent: python-urllib3/1.26.11 Aug 10 13:44:16.343757 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Auth-Token: gAAAAABi87Sor1QukN8WwkCMRH0utTzHqdtW9hBypcULvW8_thEN8NIRbRb3dRFY62pVCieUmq7t4p3U1aqc6NH3mLhkTq5eSrbHxF5HfdCRrvoVeQ0o3DpawgBQQZEUeD2RccyRTg2LrZLPb9H0A6tO9wPr-HvRM84fUPq4D0GzK22Ap72p14g Aug 10 13:44:16.343757 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Id: None Aug 10 13:44:16.343757 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Name: None Aug 10 13:44:16.343757 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Identity-Status: Confirmed Aug 10 13:44:16.343757 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Is-Admin-Project: True Aug 10 13:44:16.343757 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Id: default Aug 10 13:44:16.343757 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Name: Default Aug 10 13:44:16.343757 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Id: 48e5556cbbfd4b00aa4f6055cd6238b2 Aug 10 13:44:16.343757 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Name: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:44:16.343757 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Role: member,reader Aug 10 13:44:16.343757 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Roles: member,reader Aug 10 13:44:16.345329 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/48e5556cbbfd4b00aa4f6055cd6238b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48e5556cbbfd4b00aa4f6055cd6238b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_48e5556cbbfd4b00aa4f6055cd6238b2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48e5556cbbfd4b00aa4f6055cd6238b2"}]}] Aug 10 13:44:16.345329 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:44:16.345329 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Id: 48e5556cbbfd4b00aa4f6055cd6238b2 Aug 10 13:44:16.345329 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:44:16.345329 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User: tempest-AttachVolumeNegativeTest-965925392-project Aug 10 13:44:16.345329 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Id: default Aug 10 13:44:16.345329 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Name: Default Aug 10 13:44:16.345329 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Id: a3d9e5dc719c430eac6b5c8d8b814566 Aug 10 13:44:16.345329 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Name: tempest-AttachVolumeNegativeTest-965925392-project Aug 10 13:44:16.345329 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: method: > Aug 10 13:44:16.345329 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: exception: Instance 41baab24-f648-4e7d-83bb-4357214ea438 could not be found. Aug 10 13:44:16.345329 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: action_args: {'id': '41baab24-f648-4e7d-83bb-4357214ea438'} Aug 10 13:44:16.346246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:44:16.346246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:16.346246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:44:16.346246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:44:16.346246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:44:16.346246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:44:16.346246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:44:16.346246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:44:16.346246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:44:16.346246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:44:16.346246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41baab24-f648-4e7d-83bb-4357214ea438 could not be found. Aug 10 13:44:16.346246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:16.346246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:44:16.346246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:16.346246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:16.346246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:44:16.346246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:44:16.346246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:44:16.346246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:44:16.346246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:44:16.347855 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:44:16.347855 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 13:44:16.347855 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 13:44:16.347855 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 13:44:16.347855 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 13:44:16.347855 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:44:16.347855 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:44:16.347855 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:44:16.347855 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:44:16.347855 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41baab24-f648-4e7d-83bb-4357214ea438 could not be found. Aug 10 13:44:16.347855 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:16.347855 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:44:16.347855 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:16.347855 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:16.347855 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:44:16.347855 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:44:16.347855 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:44:16.347855 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:44:16.347855 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41baab24-f648-4e7d-83bb-4357214ea438 could not be found. Aug 10 13:44:16.347855 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:16.349415 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-7df096a7-86b5-4ad4-a513-f39638392b71 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Returning 404 to user: Instance 41baab24-f648-4e7d-83bb-4357214ea438 could not be found. {{(pid=129523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:44:16.349415 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-7df096a7-86b5-4ad4-a513-f39638392b71 tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "DELETE /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438" status: 404 len: 111 microversion: 2.1 time: 0.063881 Aug 10 13:44:16.349999 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 407/843] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 10 13:44:16 2022] DELETE /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:44:16.354847 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-930a33b2-b2cf-4d01-872f-aaee1d94eccd tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:16.355758 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-930a33b2-b2cf-4d01-872f-aaee1d94eccd tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] [instance: 41baab24-f648-4e7d-83bb-4357214ea438] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:16.363608 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-930a33b2-b2cf-4d01-872f-aaee1d94eccd tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:16.364098 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-930a33b2-b2cf-4d01-872f-aaee1d94eccd tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:16.364585 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-930a33b2-b2cf-4d01-872f-aaee1d94eccd tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:16.365331 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-930a33b2-b2cf-4d01-872f-aaee1d94eccd tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:16.365793 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-930a33b2-b2cf-4d01-872f-aaee1d94eccd tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:16.366218 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-930a33b2-b2cf-4d01-872f-aaee1d94eccd tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:16.383084 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.wsgi [None req-930a33b2-b2cf-4d01-872f-aaee1d94eccd tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] HTTP exception thrown: Instance 41baab24-f648-4e7d-83bb-4357214ea438 could not be found. Aug 10 13:44:16.384704 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-930a33b2-b2cf-4d01-872f-aaee1d94eccd tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Request method failure captured: Aug 10 13:44:16.384704 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: request: GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438 HTTP/1.1 Aug 10 13:44:16.384704 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept: application/json Aug 10 13:44:16.384704 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept-Encoding: identity Aug 10 13:44:16.384704 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Connection: close Aug 10 13:44:16.384704 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Length: 0 Aug 10 13:44:16.384704 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Type: application/json Aug 10 13:44:16.384704 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Host: 10.222.0.52 Aug 10 13:44:16.384704 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Openstack-System-Scope: None Aug 10 13:44:16.384704 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: User-Agent: python-urllib3/1.26.11 Aug 10 13:44:16.384704 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Auth-Token: gAAAAABi87Sor1QukN8WwkCMRH0utTzHqdtW9hBypcULvW8_thEN8NIRbRb3dRFY62pVCieUmq7t4p3U1aqc6NH3mLhkTq5eSrbHxF5HfdCRrvoVeQ0o3DpawgBQQZEUeD2RccyRTg2LrZLPb9H0A6tO9wPr-HvRM84fUPq4D0GzK22Ap72p14g Aug 10 13:44:16.384704 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Id: None Aug 10 13:44:16.384704 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Name: None Aug 10 13:44:16.384704 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Identity-Status: Confirmed Aug 10 13:44:16.384704 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Is-Admin-Project: True Aug 10 13:44:16.384704 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Id: default Aug 10 13:44:16.384704 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Name: Default Aug 10 13:44:16.384704 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Id: 48e5556cbbfd4b00aa4f6055cd6238b2 Aug 10 13:44:16.384704 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Name: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:44:16.384704 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Role: member,reader Aug 10 13:44:16.384704 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Roles: member,reader Aug 10 13:44:16.387475 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/48e5556cbbfd4b00aa4f6055cd6238b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48e5556cbbfd4b00aa4f6055cd6238b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_48e5556cbbfd4b00aa4f6055cd6238b2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48e5556cbbfd4b00aa4f6055cd6238b2"}]}] Aug 10 13:44:16.387475 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:44:16.387475 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Id: 48e5556cbbfd4b00aa4f6055cd6238b2 Aug 10 13:44:16.387475 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-965925392 Aug 10 13:44:16.387475 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User: tempest-AttachVolumeNegativeTest-965925392-project Aug 10 13:44:16.387475 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Id: default Aug 10 13:44:16.387475 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Name: Default Aug 10 13:44:16.387475 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Id: a3d9e5dc719c430eac6b5c8d8b814566 Aug 10 13:44:16.387475 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Name: tempest-AttachVolumeNegativeTest-965925392-project Aug 10 13:44:16.387475 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: method: > Aug 10 13:44:16.387475 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: exception: Instance 41baab24-f648-4e7d-83bb-4357214ea438 could not be found. Aug 10 13:44:16.387475 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: action_args: {'id': '41baab24-f648-4e7d-83bb-4357214ea438'} Aug 10 13:44:16.388728 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:44:16.388728 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:16.388728 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:44:16.388728 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:44:16.388728 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:44:16.388728 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:44:16.388728 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:44:16.388728 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:44:16.388728 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:44:16.388728 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:44:16.388728 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41baab24-f648-4e7d-83bb-4357214ea438 could not be found. Aug 10 13:44:16.388728 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:16.388728 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:44:16.388728 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:16.388728 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:16.388728 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:44:16.388728 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:44:16.388728 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:44:16.388728 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:44:16.388728 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:44:16.390499 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:44:16.390499 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:44:16.390499 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:44:16.390499 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:44:16.390499 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:44:16.390499 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:44:16.390499 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:44:16.390499 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41baab24-f648-4e7d-83bb-4357214ea438 could not be found. Aug 10 13:44:16.390499 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:16.390499 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:44:16.390499 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:16.390499 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:16.390499 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:44:16.390499 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:44:16.390499 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:44:16.390499 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:44:16.390499 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41baab24-f648-4e7d-83bb-4357214ea438 could not be found. Aug 10 13:44:16.390499 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:16.392031 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-930a33b2-b2cf-4d01-872f-aaee1d94eccd tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] Returning 404 to user: Instance 41baab24-f648-4e7d-83bb-4357214ea438 could not be found. {{(pid=129523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:44:16.392031 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-930a33b2-b2cf-4d01-872f-aaee1d94eccd tempest-AttachVolumeNegativeTest-965925392 tempest-AttachVolumeNegativeTest-965925392-project] 10.222.0.52 "GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438" status: 404 len: 111 microversion: 2.1 time: 0.035609 Aug 10 13:44:16.393383 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 408/844] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:44:16 2022] GET /compute/v2.1/servers/41baab24-f648-4e7d-83bb-4357214ea438 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:44:16.589642 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-d594e74e-47d0-4f41-8e21-7272695bc3ab tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "POST /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.371907 Aug 10 13:44:16.591151 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 437/845] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 10 13:44:16 2022] POST /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262/os-volume_attachments => generated 194 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:44:20.781003 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-cca2a5a6-5937-4cf5-a6ab-604736ab3183 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-186145801", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1990044180", "security_groups": [{"name": "tempest-secgroup-smoke-875459940"}], "block_device_mapping_v2": [{"uuid": "30ab853e-9155-4fa1-9f3f-fa2ace4222f8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0ffcae0f-06e6-4633-8b48-e556a2688783"}]}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:44:20.791135 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:44:20.921553 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.network.neutron [None req-cca2a5a6-5937-4cf5-a6ab-604736ab3183 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] validate_networks() for [('0ffcae0f-06e6-4633-8b48-e556a2688783', None, None, None, None, None)] {{(pid=129523) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:44:21.542704 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-cca2a5a6-5937-4cf5-a6ab-604736ab3183 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Flavor limits 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:44:21.543335 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-cca2a5a6-5937-4cf5-a6ab-604736ab3183 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Image limits 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:44:21.543839 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-cca2a5a6-5937-4cf5-a6ab-604736ab3183 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Flavor pref 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:44:21.544242 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-cca2a5a6-5937-4cf5-a6ab-604736ab3183 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Image pref 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:44:21.544644 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-cca2a5a6-5937-4cf5-a6ab-604736ab3183 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:44:21.553919 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cca2a5a6-5937-4cf5-a6ab-604736ab3183 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:21.554485 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cca2a5a6-5937-4cf5-a6ab-604736ab3183 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:21.554994 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cca2a5a6-5937-4cf5-a6ab-604736ab3183 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:21.555800 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cca2a5a6-5937-4cf5-a6ab-604736ab3183 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:21.556386 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cca2a5a6-5937-4cf5-a6ab-604736ab3183 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:21.556839 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cca2a5a6-5937-4cf5-a6ab-604736ab3183 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:21.575346 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-cca2a5a6-5937-4cf5-a6ab-604736ab3183 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Getting quotas for project b52f008781f64d09b706d478c8fe8922. Resources: {'cores', 'ram', 'instances'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:44:21.579384 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-cca2a5a6-5937-4cf5-a6ab-604736ab3183 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Getting quotas for user 411ff3f0306848ee91108343982806ca and project b52f008781f64d09b706d478c8fe8922. Resources: {'cores', 'ram', 'instances'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:44:21.662667 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-cca2a5a6-5937-4cf5-a6ab-604736ab3183 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Going to run 1 instances... {{(pid=129523) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:44:21.664714 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-cca2a5a6-5937-4cf5-a6ab-604736ab3183 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='30ab853e-9155-4fa1-9f3f-fa2ace4222f8',volume_size=None,volume_type=None)] {{(pid=129523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:44:21.795653 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-cca2a5a6-5937-4cf5-a6ab-604736ab3183 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.018368 Aug 10 13:44:21.802170 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 409/846] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 10 13:44:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 1020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 13:44:21.808234 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-135d7913-ac63-4258-96ea-edbdd5cba917 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:21.809566 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-135d7913-ac63-4258-96ea-edbdd5cba917 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:21.868817 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-135d7913-ac63-4258-96ea-edbdd5cba917 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:21.875955 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-135d7913-ac63-4258-96ea-edbdd5cba917 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1094 microversion: 2.1 time: 0.072490 Aug 10 13:44:21.876533 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 438/847] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:44:21 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:44:22.897193 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-1017ce3b-f3b7-4a0e-83f1-ce189bc768fb tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:22.897945 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-1017ce3b-f3b7-4a0e-83f1-ce189bc768fb tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:22.906733 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1017ce3b-f3b7-4a0e-83f1-ce189bc768fb tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:22.907364 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1017ce3b-f3b7-4a0e-83f1-ce189bc768fb tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:22.907818 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1017ce3b-f3b7-4a0e-83f1-ce189bc768fb tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:22.908703 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1017ce3b-f3b7-4a0e-83f1-ce189bc768fb tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:22.909199 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1017ce3b-f3b7-4a0e-83f1-ce189bc768fb tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:22.909705 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1017ce3b-f3b7-4a0e-83f1-ce189bc768fb tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:22.974789 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-1017ce3b-f3b7-4a0e-83f1-ce189bc768fb tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:22.982258 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-1017ce3b-f3b7-4a0e-83f1-ce189bc768fb tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1144 microversion: 2.1 time: 0.090157 Aug 10 13:44:22.982807 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 410/848] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:44:22 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1144 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:44:24.002759 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-362e3c1c-fe9c-4fe4-8e46-6619c5337689 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:24.003320 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-362e3c1c-fe9c-4fe4-8e46-6619c5337689 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:24.010634 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-362e3c1c-fe9c-4fe4-8e46-6619c5337689 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:24.011119 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-362e3c1c-fe9c-4fe4-8e46-6619c5337689 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:24.011550 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-362e3c1c-fe9c-4fe4-8e46-6619c5337689 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:24.012241 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-362e3c1c-fe9c-4fe4-8e46-6619c5337689 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:24.012693 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-362e3c1c-fe9c-4fe4-8e46-6619c5337689 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:24.013117 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-362e3c1c-fe9c-4fe4-8e46-6619c5337689 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:24.072702 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-362e3c1c-fe9c-4fe4-8e46-6619c5337689 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:24.080168 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-362e3c1c-fe9c-4fe4-8e46-6619c5337689 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1144 microversion: 2.1 time: 0.081369 Aug 10 13:44:24.080724 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 439/849] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:44:23 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:44:25.101220 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-cba56a9c-df2d-4bc0-be72-ce332860c109 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:25.102070 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-cba56a9c-df2d-4bc0-be72-ce332860c109 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:25.108285 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cba56a9c-df2d-4bc0-be72-ce332860c109 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:25.108770 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cba56a9c-df2d-4bc0-be72-ce332860c109 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:25.109206 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cba56a9c-df2d-4bc0-be72-ce332860c109 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:25.109917 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cba56a9c-df2d-4bc0-be72-ce332860c109 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:25.110369 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cba56a9c-df2d-4bc0-be72-ce332860c109 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:25.110793 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cba56a9c-df2d-4bc0-be72-ce332860c109 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:25.113618 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:44:25.180199 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-cba56a9c-df2d-4bc0-be72-ce332860c109 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:25.187758 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-cba56a9c-df2d-4bc0-be72-ce332860c109 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1136 microversion: 2.1 time: 0.090656 Aug 10 13:44:25.188324 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 411/850] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:44:25 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1136 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:44:25.891002 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-d8da82ad-0237-49d1-8da9-7d8588ff1c27 tempest-VolumesTestJSON-1783494886 tempest-VolumesTestJSON-1783494886-project] Calling method '.version_select at 0x7f49c44a8af0>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:25.999312 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-d8da82ad-0237-49d1-8da9-7d8588ff1c27 tempest-VolumesTestJSON-1783494886 tempest-VolumesTestJSON-1783494886-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/9ca501a0-2282-47f5-b5be-e4f940d9f2e6" status: 200 len: 350 microversion: 2.1 time: 0.111076 Aug 10 13:44:26.002038 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 440/851] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 10 13:44:25 2022] GET /compute/v2.1/os-volumes/9ca501a0-2282-47f5-b5be-e4f940d9f2e6 => generated 350 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:44:26.210564 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-89156b16-9603-42ab-8575-d2039137ac8a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:26.212353 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-89156b16-9603-42ab-8575-d2039137ac8a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:26.256618 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-89156b16-9603-42ab-8575-d2039137ac8a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:26.260758 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-89156b16-9603-42ab-8575-d2039137ac8a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:26.261566 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-89156b16-9603-42ab-8575-d2039137ac8a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:26.262620 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-89156b16-9603-42ab-8575-d2039137ac8a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:26.266823 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-89156b16-9603-42ab-8575-d2039137ac8a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:26.267554 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-89156b16-9603-42ab-8575-d2039137ac8a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:26.362382 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-89156b16-9603-42ab-8575-d2039137ac8a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:26.373497 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-89156b16-9603-42ab-8575-d2039137ac8a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1210 microversion: 2.1 time: 0.167410 Aug 10 13:44:26.374800 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 412/852] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:44:26 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1210 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:44:26.460446 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-9ef41b5f-4e5f-4693-a45a-2e1d837f574d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:26.462776 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-9ef41b5f-4e5f-4693-a45a-2e1d837f574d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 3d30c2bb-a513-4a88-a9e4-3cf892bda262] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:26.470310 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9ef41b5f-4e5f-4693-a45a-2e1d837f574d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:26.470802 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9ef41b5f-4e5f-4693-a45a-2e1d837f574d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:26.471237 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9ef41b5f-4e5f-4693-a45a-2e1d837f574d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:26.472036 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9ef41b5f-4e5f-4693-a45a-2e1d837f574d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:26.472497 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9ef41b5f-4e5f-4693-a45a-2e1d837f574d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:26.472917 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9ef41b5f-4e5f-4693-a45a-2e1d837f574d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:26.507532 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-9ef41b5f-4e5f-4693-a45a-2e1d837f574d tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051085 Aug 10 13:44:26.508393 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 441/853] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 10 13:44:26 2022] GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:44:26.660056 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-47b2d36f-0003-4cb2-b87a-67521e9de6b8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:26.663097 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-47b2d36f-0003-4cb2-b87a-67521e9de6b8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 3d30c2bb-a513-4a88-a9e4-3cf892bda262] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:26.676414 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-47b2d36f-0003-4cb2-b87a-67521e9de6b8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:26.677179 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-47b2d36f-0003-4cb2-b87a-67521e9de6b8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:26.677802 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-47b2d36f-0003-4cb2-b87a-67521e9de6b8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:26.678905 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-47b2d36f-0003-4cb2-b87a-67521e9de6b8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:26.679495 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-47b2d36f-0003-4cb2-b87a-67521e9de6b8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:26.680020 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-47b2d36f-0003-4cb2-b87a-67521e9de6b8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:26.722554 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-47b2d36f-0003-4cb2-b87a-67521e9de6b8 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262/os-volume_attachments/5a1ec6ef-5989-47c4-b666-51d800ed75f0" status: 200 len: 194 microversion: 2.1 time: 0.073925 Aug 10 13:44:26.722991 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 413/854] 10.222.0.52 () {58 vars in 1413 bytes} [Wed Aug 10 13:44:26 2022] GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262/os-volume_attachments/5a1ec6ef-5989-47c4-b666-51d800ed75f0 => generated 194 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:44:26.734978 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-03c1394b-a5d6-4b7b-b97d-bfda1d98a859 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:26.735810 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-03c1394b-a5d6-4b7b-b97d-bfda1d98a859 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 3d30c2bb-a513-4a88-a9e4-3cf892bda262] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:26.743407 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-03c1394b-a5d6-4b7b-b97d-bfda1d98a859 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:26.744344 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-03c1394b-a5d6-4b7b-b97d-bfda1d98a859 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:26.745073 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-03c1394b-a5d6-4b7b-b97d-bfda1d98a859 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:26.746618 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-03c1394b-a5d6-4b7b-b97d-bfda1d98a859 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:26.747237 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-03c1394b-a5d6-4b7b-b97d-bfda1d98a859 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:26.748422 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-03c1394b-a5d6-4b7b-b97d-bfda1d98a859 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:26.845305 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.objects.instance [None req-03c1394b-a5d6-4b7b-b97d-bfda1d98a859 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lazy-loading 'services' on Instance uuid 3d30c2bb-a513-4a88-a9e4-3cf892bda262 {{(pid=129522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:44:26.922345 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:44:26.938689 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-03c1394b-a5d6-4b7b-b97d-bfda1d98a859 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262/os-volume_attachments/5a1ec6ef-5989-47c4-b666-51d800ed75f0" status: 202 len: 0 microversion: 2.1 time: 0.208904 Aug 10 13:44:26.939423 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 442/855] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Aug 10 13:44:26 2022] DELETE /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262/os-volume_attachments/5a1ec6ef-5989-47c4-b666-51d800ed75f0 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:44:27.333216 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-97026981-9be5-46de-963c-8efa67b9252d req-9580d8e7-2031-43f6-a104-7fc56de9b905 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52cd9b3e-aa05-41f0-b17a-d78f06e5d176", "tag": "3874b623-0ac2-47e5-88e0-78f207e051a4"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:44:27.352316 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-97026981-9be5-46de-963c-8efa67b9252d req-9580d8e7-2031-43f6-a104-7fc56de9b905 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:27.352950 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-97026981-9be5-46de-963c-8efa67b9252d req-9580d8e7-2031-43f6-a104-7fc56de9b905 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:27.353491 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-97026981-9be5-46de-963c-8efa67b9252d req-9580d8e7-2031-43f6-a104-7fc56de9b905 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:27.368200 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-97026981-9be5-46de-963c-8efa67b9252d req-9580d8e7-2031-43f6-a104-7fc56de9b905 service nova] Creating event network-changed:3874b623-0ac2-47e5-88e0-78f207e051a4 for instance 52cd9b3e-aa05-41f0-b17a-d78f06e5d176 on hv-cinder-85200 Aug 10 13:44:27.376790 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-97026981-9be5-46de-963c-8efa67b9252d req-9580d8e7-2031-43f6-a104-7fc56de9b905 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044168 Aug 10 13:44:27.377968 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 414/856] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:44:27.397390 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-9d178979-91ec-4edd-b37c-801139e261c4 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:27.397390 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-9d178979-91ec-4edd-b37c-801139e261c4 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:27.408898 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9d178979-91ec-4edd-b37c-801139e261c4 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:27.409431 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9d178979-91ec-4edd-b37c-801139e261c4 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:27.409916 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9d178979-91ec-4edd-b37c-801139e261c4 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:27.410808 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9d178979-91ec-4edd-b37c-801139e261c4 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:27.411438 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9d178979-91ec-4edd-b37c-801139e261c4 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:27.412041 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9d178979-91ec-4edd-b37c-801139e261c4 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:27.483052 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-90a52419-34df-4dc6-9ba8-b8906a1796b3 tempest-VolumesTestJSON-1783494886 tempest-VolumesTestJSON-1783494886-project] Calling method '.version_select at 0x7f49c43a4310>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:27.541620 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-90a52419-34df-4dc6-9ba8-b8906a1796b3 tempest-VolumesTestJSON-1783494886 tempest-VolumesTestJSON-1783494886-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/92a4ad66-239a-4ffb-91ce-b8cc45aa143b" status: 200 len: 350 microversion: 2.1 time: 0.064388 Aug 10 13:44:27.542406 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 415/857] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 10 13:44:27 2022] GET /compute/v2.1/os-volumes/92a4ad66-239a-4ffb-91ce-b8cc45aa143b => generated 350 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:44:27.555225 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-9d178979-91ec-4edd-b37c-801139e261c4 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:27.564415 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-9d178979-91ec-4edd-b37c-801139e261c4 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1265 microversion: 2.1 time: 0.173661 Aug 10 13:44:27.576238 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 443/858] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:44:27 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:44:28.070341 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-2b547704-058d-476b-89d3-a8ac821b2249 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:28.070971 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-2b547704-058d-476b-89d3-a8ac821b2249 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 3d30c2bb-a513-4a88-a9e4-3cf892bda262] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:28.080176 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2b547704-058d-476b-89d3-a8ac821b2249 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:28.080681 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2b547704-058d-476b-89d3-a8ac821b2249 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:28.081440 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2b547704-058d-476b-89d3-a8ac821b2249 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:28.082109 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2b547704-058d-476b-89d3-a8ac821b2249 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:28.082564 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2b547704-058d-476b-89d3-a8ac821b2249 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:28.082987 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2b547704-058d-476b-89d3-a8ac821b2249 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:28.116912 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-2b547704-058d-476b-89d3-a8ac821b2249 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262/os-volume_attachments/d223b467-800f-47c4-870e-4eaf418e0047" status: 200 len: 194 microversion: 2.1 time: 0.050762 Aug 10 13:44:28.117553 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 416/859] 10.222.0.52 () {58 vars in 1413 bytes} [Wed Aug 10 13:44:28 2022] GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262/os-volume_attachments/d223b467-800f-47c4-870e-4eaf418e0047 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:44:28.129523 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-2b3c464b-48b6-4ceb-9a3e-97a35d0f5a12 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:28.130440 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-2b3c464b-48b6-4ceb-9a3e-97a35d0f5a12 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 3d30c2bb-a513-4a88-a9e4-3cf892bda262] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:28.138130 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2b3c464b-48b6-4ceb-9a3e-97a35d0f5a12 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:28.138619 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2b3c464b-48b6-4ceb-9a3e-97a35d0f5a12 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:28.139052 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2b3c464b-48b6-4ceb-9a3e-97a35d0f5a12 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:28.139764 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2b3c464b-48b6-4ceb-9a3e-97a35d0f5a12 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:28.140249 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2b3c464b-48b6-4ceb-9a3e-97a35d0f5a12 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:28.140636 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2b3c464b-48b6-4ceb-9a3e-97a35d0f5a12 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:28.234719 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.objects.instance [None req-2b3c464b-48b6-4ceb-9a3e-97a35d0f5a12 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lazy-loading 'services' on Instance uuid 3d30c2bb-a513-4a88-a9e4-3cf892bda262 {{(pid=129522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:44:28.462357 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-2b3c464b-48b6-4ceb-9a3e-97a35d0f5a12 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262/os-volume_attachments/d223b467-800f-47c4-870e-4eaf418e0047" status: 202 len: 0 microversion: 2.1 time: 0.336914 Aug 10 13:44:28.462951 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 444/860] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Aug 10 13:44:28 2022] DELETE /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262/os-volume_attachments/d223b467-800f-47c4-870e-4eaf418e0047 => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:44:28.587005 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-7ed7fc2f-4776-49d9-befb-863c07675d6f tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:28.587679 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-7ed7fc2f-4776-49d9-befb-863c07675d6f tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:28.594507 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7ed7fc2f-4776-49d9-befb-863c07675d6f tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:28.594998 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7ed7fc2f-4776-49d9-befb-863c07675d6f tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:28.595475 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7ed7fc2f-4776-49d9-befb-863c07675d6f tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:28.596167 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7ed7fc2f-4776-49d9-befb-863c07675d6f tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:28.596620 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7ed7fc2f-4776-49d9-befb-863c07675d6f tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:28.597215 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7ed7fc2f-4776-49d9-befb-863c07675d6f tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:28.814399 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-7ed7fc2f-4776-49d9-befb-863c07675d6f tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:28.822299 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-7ed7fc2f-4776-49d9-befb-863c07675d6f tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1265 microversion: 2.1 time: 0.239405 Aug 10 13:44:28.822862 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 417/861] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:44:28 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1265 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:44:28.919602 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-efa07c56-2243-4437-ac4b-eea48e9b6add tempest-VolumesTestJSON-1783494886 tempest-VolumesTestJSON-1783494886-project] Calling method '.version_select at 0x7f49c4436e50>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:28.969686 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-efa07c56-2243-4437-ac4b-eea48e9b6add tempest-VolumesTestJSON-1783494886 tempest-VolumesTestJSON-1783494886-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/1190565f-006f-4894-8c19-a7a7d6545394" status: 200 len: 350 microversion: 2.1 time: 0.054626 Aug 10 13:44:28.970398 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 445/862] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 10 13:44:28 2022] GET /compute/v2.1/os-volumes/1190565f-006f-4894-8c19-a7a7d6545394 => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:44:28.983801 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-b71b559c-3f67-4697-b785-501cf5761676 tempest-VolumesTestJSON-1783494886 tempest-VolumesTestJSON-1783494886-project] Calling method '.version_select at 0x7f49c4478430>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:29.076424 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-b71b559c-3f67-4697-b785-501cf5761676 tempest-VolumesTestJSON-1783494886 tempest-VolumesTestJSON-1783494886-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.096823 Aug 10 13:44:29.077015 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 418/863] 10.222.0.52 () {58 vars in 1134 bytes} [Wed Aug 10 13:44:28 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:44:29.092267 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-65ac0c59-1de2-4403-b3dc-7231158dfd2b tempest-VolumesTestJSON-1783494886 tempest-VolumesTestJSON-1783494886-project] Calling method '.version_select at 0x7f49c44a8af0>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:29.188489 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-65ac0c59-1de2-4403-b3dc-7231158dfd2b tempest-VolumesTestJSON-1783494886 tempest-VolumesTestJSON-1783494886-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.100446 Aug 10 13:44:29.189130 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 446/864] 10.222.0.52 () {58 vars in 1149 bytes} [Wed Aug 10 13:44:29 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:44:29.202611 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-afb9e72a-861b-4cca-ace9-84997e7d540b tempest-VolumesTestJSON-1783494886 tempest-VolumesTestJSON-1783494886-project] Calling method '.version_select at 0x7f49c43b1310>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:29.287991 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-afb9e72a-861b-4cca-ace9-84997e7d540b tempest-VolumesTestJSON-1783494886 tempest-VolumesTestJSON-1783494886-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.088878 Aug 10 13:44:29.288810 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 419/865] 10.222.0.52 () {58 vars in 1134 bytes} [Wed Aug 10 13:44:29 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:44:29.302021 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-e4bcb756-3858-4f4c-931c-b6e71544a37f tempest-VolumesTestJSON-1783494886 tempest-VolumesTestJSON-1783494886-project] Calling method '.version_select at 0x7f49c44a8c10>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:29.394693 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-e4bcb756-3858-4f4c-931c-b6e71544a37f tempest-VolumesTestJSON-1783494886 tempest-VolumesTestJSON-1783494886-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.096081 Aug 10 13:44:29.395946 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 447/866] 10.222.0.52 () {58 vars in 1167 bytes} [Wed Aug 10 13:44:29 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:44:29.412694 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-6c068e05-5046-4103-979c-f9c88fbe0b37 tempest-VolumesTestJSON-1783494886 tempest-VolumesTestJSON-1783494886-project] Calling method '.version_select at 0x7f49c44c5dc0>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:29.500849 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-6c068e05-5046-4103-979c-f9c88fbe0b37 tempest-VolumesTestJSON-1783494886 tempest-VolumesTestJSON-1783494886-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.093752 Aug 10 13:44:29.501466 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 420/867] 10.222.0.52 () {58 vars in 1170 bytes} [Wed Aug 10 13:44:29 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:44:29.515471 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-62de4e62-52ac-4cbc-a37d-efd306cbe443 tempest-VolumesTestJSON-1783494886 tempest-VolumesTestJSON-1783494886-project] Calling method '.version_select at 0x7f49c44e2280>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:29.600873 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-62de4e62-52ac-4cbc-a37d-efd306cbe443 tempest-VolumesTestJSON-1783494886 tempest-VolumesTestJSON-1783494886-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.089676 Aug 10 13:44:29.601463 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 448/868] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Aug 10 13:44:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:44:29.614935 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-ac52685d-978e-4c0f-b63b-48cb011ce958 tempest-VolumesTestJSON-1783494886 tempest-VolumesTestJSON-1783494886-project] Calling method '.version_select at 0x7f49c4495280>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:29.636811 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-baf5e2a8-f7ea-4b33-ae53-a47f2d091448 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:29.639676 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-baf5e2a8-f7ea-4b33-ae53-a47f2d091448 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 3d30c2bb-a513-4a88-a9e4-3cf892bda262] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:29.641865 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:44:29.647815 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-baf5e2a8-f7ea-4b33-ae53-a47f2d091448 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:29.648307 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-baf5e2a8-f7ea-4b33-ae53-a47f2d091448 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:29.648742 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-baf5e2a8-f7ea-4b33-ae53-a47f2d091448 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:29.649476 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-baf5e2a8-f7ea-4b33-ae53-a47f2d091448 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:29.649962 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-baf5e2a8-f7ea-4b33-ae53-a47f2d091448 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:29.650390 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-baf5e2a8-f7ea-4b33-ae53-a47f2d091448 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:29.681369 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-baf5e2a8-f7ea-4b33-ae53-a47f2d091448 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048595 Aug 10 13:44:29.681938 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 449/869] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 10 13:44:29 2022] GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 13:44:29.704006 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-ac52685d-978e-4c0f-b63b-48cb011ce958 tempest-VolumesTestJSON-1783494886 tempest-VolumesTestJSON-1783494886-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.093551 Aug 10 13:44:29.704667 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 421/870] 10.222.0.52 () {58 vars in 1188 bytes} [Wed Aug 10 13:44:29 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:44:29.718041 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-242a53f8-e096-437d-83f5-4ab78ac21e34 tempest-VolumesTestJSON-1783494886 tempest-VolumesTestJSON-1783494886-project] Calling method '.version_select at 0x7f49c450c790>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:29.799352 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-dea6c82b-0fae-4592-bf0b-08c825d71d10 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:29.800666 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-242a53f8-e096-437d-83f5-4ab78ac21e34 tempest-VolumesTestJSON-1783494886 tempest-VolumesTestJSON-1783494886-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.087076 Aug 10 13:44:29.801253 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 450/871] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Aug 10 13:44:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:44:29.806996 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-dea6c82b-0fae-4592-bf0b-08c825d71d10 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 3d30c2bb-a513-4a88-a9e4-3cf892bda262] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:29.816706 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-dea6c82b-0fae-4592-bf0b-08c825d71d10 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:29.816706 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-dea6c82b-0fae-4592-bf0b-08c825d71d10 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:29.817013 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-dea6c82b-0fae-4592-bf0b-08c825d71d10 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:29.817712 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-dea6c82b-0fae-4592-bf0b-08c825d71d10 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:29.818186 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-dea6c82b-0fae-4592-bf0b-08c825d71d10 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:29.818597 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-dea6c82b-0fae-4592-bf0b-08c825d71d10 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:29.842972 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-94a939ee-b0ee-4ade-8364-66786dfc21ff tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:29.843592 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-94a939ee-b0ee-4ade-8364-66786dfc21ff tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:29.853914 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-94a939ee-b0ee-4ade-8364-66786dfc21ff tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:29.854492 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-dea6c82b-0fae-4592-bf0b-08c825d71d10 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058966 Aug 10 13:44:29.854894 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-94a939ee-b0ee-4ade-8364-66786dfc21ff tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:29.855258 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 422/872] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 10 13:44:29 2022] GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 13:44:29.855763 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-94a939ee-b0ee-4ade-8364-66786dfc21ff tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:29.856742 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-94a939ee-b0ee-4ade-8364-66786dfc21ff tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:29.857616 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-94a939ee-b0ee-4ade-8364-66786dfc21ff tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:29.858717 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-94a939ee-b0ee-4ade-8364-66786dfc21ff tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:29.958372 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-f095fcd0-833f-4f4f-9585-1dc12b188a2c tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:29.958893 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-f095fcd0-833f-4f4f-9585-1dc12b188a2c tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 3d30c2bb-a513-4a88-a9e4-3cf892bda262] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:29.966170 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f095fcd0-833f-4f4f-9585-1dc12b188a2c tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:29.966855 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f095fcd0-833f-4f4f-9585-1dc12b188a2c tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:29.967570 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f095fcd0-833f-4f4f-9585-1dc12b188a2c tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:29.968419 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f095fcd0-833f-4f4f-9585-1dc12b188a2c tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:29.968972 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f095fcd0-833f-4f4f-9585-1dc12b188a2c tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:29.969515 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f095fcd0-833f-4f4f-9585-1dc12b188a2c tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:30.007913 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-f095fcd0-833f-4f4f-9585-1dc12b188a2c tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 3d30c2bb-a513-4a88-a9e4-3cf892bda262] Going to try to terminate instance {{(pid=129523) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:44:30.028087 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-94a939ee-b0ee-4ade-8364-66786dfc21ff tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:30.035941 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-94a939ee-b0ee-4ade-8364-66786dfc21ff tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1265 microversion: 2.1 time: 0.196817 Aug 10 13:44:30.037834 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 451/873] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:44:29 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:44:30.100809 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-f095fcd0-833f-4f4f-9585-1dc12b188a2c tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262" status: 204 len: 0 microversion: 2.1 time: 0.149932 Aug 10 13:44:30.102103 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 423/874] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 10 13:44:29 2022] DELETE /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:44:30.114764 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-771cc0f4-001f-4815-8e4f-f70f2b06b90c tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:30.115477 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-771cc0f4-001f-4815-8e4f-f70f2b06b90c tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 3d30c2bb-a513-4a88-a9e4-3cf892bda262] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:30.121576 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-771cc0f4-001f-4815-8e4f-f70f2b06b90c tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:30.122516 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-771cc0f4-001f-4815-8e4f-f70f2b06b90c tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:30.122953 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-771cc0f4-001f-4815-8e4f-f70f2b06b90c tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:30.123729 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-771cc0f4-001f-4815-8e4f-f70f2b06b90c tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:30.124194 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-771cc0f4-001f-4815-8e4f-f70f2b06b90c tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:30.124610 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-771cc0f4-001f-4815-8e4f-f70f2b06b90c tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:30.274211 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-771cc0f4-001f-4815-8e4f-f70f2b06b90c tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:30.282118 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-771cc0f4-001f-4815-8e4f-f70f2b06b90c tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262" status: 200 len: 1673 microversion: 2.1 time: 0.171982 Aug 10 13:44:30.282677 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 452/875] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:44:30 2022] GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262 => generated 1673 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:44:31.057574 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-6b9591d1-c2f0-4f8b-8d85-ee3a1999b97e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:31.058306 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-6b9591d1-c2f0-4f8b-8d85-ee3a1999b97e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:31.064943 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6b9591d1-c2f0-4f8b-8d85-ee3a1999b97e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:31.065472 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6b9591d1-c2f0-4f8b-8d85-ee3a1999b97e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:31.065915 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6b9591d1-c2f0-4f8b-8d85-ee3a1999b97e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:31.066736 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6b9591d1-c2f0-4f8b-8d85-ee3a1999b97e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:31.067187 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6b9591d1-c2f0-4f8b-8d85-ee3a1999b97e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:31.067607 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6b9591d1-c2f0-4f8b-8d85-ee3a1999b97e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:31.221861 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-6b9591d1-c2f0-4f8b-8d85-ee3a1999b97e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:31.229755 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-6b9591d1-c2f0-4f8b-8d85-ee3a1999b97e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1265 microversion: 2.1 time: 0.176705 Aug 10 13:44:31.230331 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 424/876] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:44:31 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:44:31.303992 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-84e93a05-62bc-4662-acf9-e4a2dd025d81 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:31.304642 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-84e93a05-62bc-4662-acf9-e4a2dd025d81 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 3d30c2bb-a513-4a88-a9e4-3cf892bda262] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:31.312898 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-84e93a05-62bc-4662-acf9-e4a2dd025d81 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:31.313457 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-84e93a05-62bc-4662-acf9-e4a2dd025d81 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:31.314019 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-84e93a05-62bc-4662-acf9-e4a2dd025d81 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:31.314954 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-84e93a05-62bc-4662-acf9-e4a2dd025d81 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:31.315407 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-84e93a05-62bc-4662-acf9-e4a2dd025d81 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:31.315833 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-84e93a05-62bc-4662-acf9-e4a2dd025d81 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:31.466894 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-84e93a05-62bc-4662-acf9-e4a2dd025d81 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:31.475218 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-84e93a05-62bc-4662-acf9-e4a2dd025d81 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262" status: 200 len: 1673 microversion: 2.1 time: 0.175268 Aug 10 13:44:31.475846 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 453/877] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:44:31 2022] GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262 => generated 1673 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:44:32.250891 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell0:SELECT=2 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:44:32.250891 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell0:SELECT=6 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:44:32.259249 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-859130d4-378b-4b02-86ad-7779693928f7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:32.260613 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-859130d4-378b-4b02-86ad-7779693928f7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:32.271505 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-859130d4-378b-4b02-86ad-7779693928f7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:32.272710 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-859130d4-378b-4b02-86ad-7779693928f7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:32.273402 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-859130d4-378b-4b02-86ad-7779693928f7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:32.274523 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-859130d4-378b-4b02-86ad-7779693928f7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:32.275210 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-859130d4-378b-4b02-86ad-7779693928f7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:32.275877 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-859130d4-378b-4b02-86ad-7779693928f7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:32.499937 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-73ade3b5-c349-416b-8867-5bfd3c0c0847 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:32.501027 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-73ade3b5-c349-416b-8867-5bfd3c0c0847 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 3d30c2bb-a513-4a88-a9e4-3cf892bda262] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:32.520402 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell0:SELECT=2 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:44:32.525924 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-73ade3b5-c349-416b-8867-5bfd3c0c0847 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:32.526447 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-73ade3b5-c349-416b-8867-5bfd3c0c0847 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:32.526861 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-73ade3b5-c349-416b-8867-5bfd3c0c0847 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:32.527575 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-73ade3b5-c349-416b-8867-5bfd3c0c0847 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:32.528089 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-73ade3b5-c349-416b-8867-5bfd3c0c0847 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:32.528515 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-73ade3b5-c349-416b-8867-5bfd3c0c0847 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:32.578460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-859130d4-378b-4b02-86ad-7779693928f7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:32.591450 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-859130d4-378b-4b02-86ad-7779693928f7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1265 microversion: 2.1 time: 0.343690 Aug 10 13:44:32.592180 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 425/878] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:44:32 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1265 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:44:32.695614 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-73ade3b5-c349-416b-8867-5bfd3c0c0847 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c7d8b89cd445a924f5ac07e85fe48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f889848d459459484b5b5517fef576b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:32.708352 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-73ade3b5-c349-416b-8867-5bfd3c0c0847 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262" status: 200 len: 1673 microversion: 2.1 time: 0.214475 Aug 10 13:44:32.710231 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 454/879] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:44:32 2022] GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262 => generated 1673 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:44:33.073361 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-63c73132-b028-4061-ba23-bad11c0e36fb req-33640bab-fc67-48a6-a402-dc32f76e80e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d30c2bb-a513-4a88-a9e4-3cf892bda262", "name": "network-vif-deleted", "tag": "43a79878-e56a-45c7-8b88-233e7d8b4349"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:44:33.085114 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-63c73132-b028-4061-ba23-bad11c0e36fb req-33640bab-fc67-48a6-a402-dc32f76e80e6 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:33.085652 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-63c73132-b028-4061-ba23-bad11c0e36fb req-33640bab-fc67-48a6-a402-dc32f76e80e6 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:33.086116 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-63c73132-b028-4061-ba23-bad11c0e36fb req-33640bab-fc67-48a6-a402-dc32f76e80e6 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:33.100623 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-63c73132-b028-4061-ba23-bad11c0e36fb req-33640bab-fc67-48a6-a402-dc32f76e80e6 service nova] Creating event network-vif-deleted:43a79878-e56a-45c7-8b88-233e7d8b4349 for instance 3d30c2bb-a513-4a88-a9e4-3cf892bda262 on hv-cinder-85200 Aug 10 13:44:33.106491 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-63c73132-b028-4061-ba23-bad11c0e36fb req-33640bab-fc67-48a6-a402-dc32f76e80e6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036499 Aug 10 13:44:33.107148 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 426/880] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:44:33.615405 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-9517227d-3f6e-4a5c-98bd-ab5bd7ab9cb4 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:33.616213 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-9517227d-3f6e-4a5c-98bd-ab5bd7ab9cb4 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:33.626514 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9517227d-3f6e-4a5c-98bd-ab5bd7ab9cb4 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:33.627049 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9517227d-3f6e-4a5c-98bd-ab5bd7ab9cb4 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:33.627485 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9517227d-3f6e-4a5c-98bd-ab5bd7ab9cb4 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:33.628193 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9517227d-3f6e-4a5c-98bd-ab5bd7ab9cb4 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:33.628654 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9517227d-3f6e-4a5c-98bd-ab5bd7ab9cb4 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:33.629081 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9517227d-3f6e-4a5c-98bd-ab5bd7ab9cb4 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:33.738547 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-f3d85b75-520a-4774-8099-1c268e6313d7 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:33.739452 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-f3d85b75-520a-4774-8099-1c268e6313d7 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 3d30c2bb-a513-4a88-a9e4-3cf892bda262] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:33.748588 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f3d85b75-520a-4774-8099-1c268e6313d7 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:33.749416 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f3d85b75-520a-4774-8099-1c268e6313d7 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:33.750275 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f3d85b75-520a-4774-8099-1c268e6313d7 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:33.751098 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f3d85b75-520a-4774-8099-1c268e6313d7 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:33.751639 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f3d85b75-520a-4774-8099-1c268e6313d7 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:33.752163 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-f3d85b75-520a-4774-8099-1c268e6313d7 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:33.772437 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.wsgi [None req-f3d85b75-520a-4774-8099-1c268e6313d7 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] HTTP exception thrown: Instance 3d30c2bb-a513-4a88-a9e4-3cf892bda262 could not be found. Aug 10 13:44:33.775614 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-f3d85b75-520a-4774-8099-1c268e6313d7 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Request method failure captured: Aug 10 13:44:33.775614 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: request: GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262 HTTP/1.1 Aug 10 13:44:33.775614 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept: application/json Aug 10 13:44:33.775614 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept-Encoding: identity Aug 10 13:44:33.775614 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Connection: close Aug 10 13:44:33.775614 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Length: 0 Aug 10 13:44:33.775614 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Type: application/json Aug 10 13:44:33.775614 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Host: 10.222.0.52 Aug 10 13:44:33.775614 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Openstack-System-Scope: None Aug 10 13:44:33.775614 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: User-Agent: python-urllib3/1.26.11 Aug 10 13:44:33.775614 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Auth-Token: gAAAAABi87SyBFBTkzIY0ISubWBiCPDiFQUyewnxnl7oGdfB5bLCdvtusNqIu_rxLiQmzA10NW-oLYnxkPKTRJxOWt6GCY4FSu918nxANV0rrJqErzPZFzHVcO3Q7M6u16ou_0R64Gx1Pk4MSTjnQcksYaErDaz6zlJQY8VAw20k3gMYZDkoYKE Aug 10 13:44:33.775614 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Id: None Aug 10 13:44:33.775614 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Name: None Aug 10 13:44:33.775614 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Identity-Status: Confirmed Aug 10 13:44:33.775614 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Is-Admin-Project: True Aug 10 13:44:33.775614 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Id: default Aug 10 13:44:33.775614 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Name: Default Aug 10 13:44:33.775614 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Id: 6f889848d459459484b5b5517fef576b Aug 10 13:44:33.775614 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Name: tempest-AttachVolumeTestJSON-1472892946 Aug 10 13:44:33.775614 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Role: member,reader Aug 10 13:44:33.775614 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Roles: member,reader Aug 10 13:44:33.779311 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6f889848d459459484b5b5517fef576b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6f889848d459459484b5b5517fef576b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6f889848d459459484b5b5517fef576b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6f889848d459459484b5b5517fef576b"}]}] Aug 10 13:44:33.779311 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant: tempest-AttachVolumeTestJSON-1472892946 Aug 10 13:44:33.779311 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Id: 6f889848d459459484b5b5517fef576b Aug 10 13:44:33.779311 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1472892946 Aug 10 13:44:33.779311 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User: tempest-AttachVolumeTestJSON-1472892946-project Aug 10 13:44:33.779311 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Id: default Aug 10 13:44:33.779311 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Name: Default Aug 10 13:44:33.779311 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Id: 289c7d8b89cd445a924f5ac07e85fe48 Aug 10 13:44:33.779311 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Name: tempest-AttachVolumeTestJSON-1472892946-project Aug 10 13:44:33.779311 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: method: > Aug 10 13:44:33.779311 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: exception: Instance 3d30c2bb-a513-4a88-a9e4-3cf892bda262 could not be found. Aug 10 13:44:33.779311 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: action_args: {'id': '3d30c2bb-a513-4a88-a9e4-3cf892bda262'} Aug 10 13:44:33.782229 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:44:33.782229 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:33.782229 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:44:33.782229 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:44:33.782229 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:44:33.782229 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:44:33.782229 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:44:33.782229 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:44:33.782229 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:44:33.782229 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:44:33.782229 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d30c2bb-a513-4a88-a9e4-3cf892bda262 could not be found. Aug 10 13:44:33.782229 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:33.782229 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:44:33.782229 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:33.782229 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:33.782229 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:44:33.782229 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:44:33.782229 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:44:33.782229 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:44:33.782229 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:44:33.786059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:44:33.786059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:44:33.786059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:44:33.786059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:44:33.786059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:44:33.786059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:44:33.786059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:44:33.786059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d30c2bb-a513-4a88-a9e4-3cf892bda262 could not be found. Aug 10 13:44:33.786059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:33.786059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:44:33.786059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:33.786059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:33.786059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:44:33.786059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:44:33.786059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:44:33.786059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:44:33.786059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d30c2bb-a513-4a88-a9e4-3cf892bda262 could not be found. Aug 10 13:44:33.786059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:33.792125 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-f3d85b75-520a-4774-8099-1c268e6313d7 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Returning 404 to user: Instance 3d30c2bb-a513-4a88-a9e4-3cf892bda262 could not be found. {{(pid=129523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:44:33.792574 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-f3d85b75-520a-4774-8099-1c268e6313d7 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262" status: 404 len: 111 microversion: 2.1 time: 0.055881 Aug 10 13:44:33.794806 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 427/881] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:44:33 2022] GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 13:44:33.805695 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-48574598-88cf-435f-a931-263ee2167290 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '.version_select at 0x7f49c43a4f70>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:33.835808 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-48574598-88cf-435f-a931-263ee2167290 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1870924499" status: 202 len: 0 microversion: 2.1 time: 0.033743 Aug 10 13:44:33.837141 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 428/882] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Aug 10 13:44:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1870924499 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:44:33.849125 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-9517227d-3f6e-4a5c-98bd-ab5bd7ab9cb4 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:33.876054 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-9517227d-3f6e-4a5c-98bd-ab5bd7ab9cb4 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1265 microversion: 2.1 time: 0.266236 Aug 10 13:44:33.879340 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 455/883] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:44:33 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1265 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:44:34.906593 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-741c81fe-a3c3-48c4-a012-8b2df10ec4fc tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:34.907316 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-741c81fe-a3c3-48c4-a012-8b2df10ec4fc tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:34.915378 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-741c81fe-a3c3-48c4-a012-8b2df10ec4fc tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:34.916155 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-741c81fe-a3c3-48c4-a012-8b2df10ec4fc tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:34.916590 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-741c81fe-a3c3-48c4-a012-8b2df10ec4fc tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:34.917324 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-741c81fe-a3c3-48c4-a012-8b2df10ec4fc tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:34.917795 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-741c81fe-a3c3-48c4-a012-8b2df10ec4fc tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:34.918213 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-741c81fe-a3c3-48c4-a012-8b2df10ec4fc tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:35.080459 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-741c81fe-a3c3-48c4-a012-8b2df10ec4fc tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:35.089050 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-741c81fe-a3c3-48c4-a012-8b2df10ec4fc tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1265 microversion: 2.1 time: 0.190653 Aug 10 13:44:35.090025 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 429/884] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:44:34 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:44:36.114479 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-eab2da61-3ad3-4e2b-bc63-e50f3706d6d2 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:36.116028 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-eab2da61-3ad3-4e2b-bc63-e50f3706d6d2 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:36.124662 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-eab2da61-3ad3-4e2b-bc63-e50f3706d6d2 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:36.125153 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-eab2da61-3ad3-4e2b-bc63-e50f3706d6d2 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:36.125659 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-eab2da61-3ad3-4e2b-bc63-e50f3706d6d2 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:36.126539 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-eab2da61-3ad3-4e2b-bc63-e50f3706d6d2 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:36.127006 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-eab2da61-3ad3-4e2b-bc63-e50f3706d6d2 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:36.127431 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-eab2da61-3ad3-4e2b-bc63-e50f3706d6d2 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:36.275911 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-eab2da61-3ad3-4e2b-bc63-e50f3706d6d2 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:36.283932 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-eab2da61-3ad3-4e2b-bc63-e50f3706d6d2 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1265 microversion: 2.1 time: 0.176743 Aug 10 13:44:36.284683 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 456/885] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:44:36 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:44:36.983256 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-6c7a6625-b6bf-4c72-b14e-2cf6af95e174 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:36.983754 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-6c7a6625-b6bf-4c72-b14e-2cf6af95e174 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 3d30c2bb-a513-4a88-a9e4-3cf892bda262] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:36.990475 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6c7a6625-b6bf-4c72-b14e-2cf6af95e174 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:36.990965 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6c7a6625-b6bf-4c72-b14e-2cf6af95e174 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:36.991404 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6c7a6625-b6bf-4c72-b14e-2cf6af95e174 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:36.992105 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6c7a6625-b6bf-4c72-b14e-2cf6af95e174 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:36.992563 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6c7a6625-b6bf-4c72-b14e-2cf6af95e174 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:36.992992 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6c7a6625-b6bf-4c72-b14e-2cf6af95e174 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:37.006721 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.wsgi [None req-6c7a6625-b6bf-4c72-b14e-2cf6af95e174 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] HTTP exception thrown: Instance 3d30c2bb-a513-4a88-a9e4-3cf892bda262 could not be found. Aug 10 13:44:37.008280 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-6c7a6625-b6bf-4c72-b14e-2cf6af95e174 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Request method failure captured: Aug 10 13:44:37.008280 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: request: DELETE /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262 HTTP/1.1 Aug 10 13:44:37.008280 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept: application/json Aug 10 13:44:37.008280 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept-Encoding: identity Aug 10 13:44:37.008280 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Connection: close Aug 10 13:44:37.008280 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Length: 0 Aug 10 13:44:37.008280 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Type: application/json Aug 10 13:44:37.008280 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Host: 10.222.0.52 Aug 10 13:44:37.008280 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Openstack-System-Scope: None Aug 10 13:44:37.008280 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: User-Agent: python-urllib3/1.26.11 Aug 10 13:44:37.008280 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Auth-Token: gAAAAABi87SyBFBTkzIY0ISubWBiCPDiFQUyewnxnl7oGdfB5bLCdvtusNqIu_rxLiQmzA10NW-oLYnxkPKTRJxOWt6GCY4FSu918nxANV0rrJqErzPZFzHVcO3Q7M6u16ou_0R64Gx1Pk4MSTjnQcksYaErDaz6zlJQY8VAw20k3gMYZDkoYKE Aug 10 13:44:37.008280 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Id: None Aug 10 13:44:37.008280 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Name: None Aug 10 13:44:37.008280 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Identity-Status: Confirmed Aug 10 13:44:37.008280 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Is-Admin-Project: True Aug 10 13:44:37.008280 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Id: default Aug 10 13:44:37.008280 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Name: Default Aug 10 13:44:37.008280 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Id: 6f889848d459459484b5b5517fef576b Aug 10 13:44:37.008280 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Name: tempest-AttachVolumeTestJSON-1472892946 Aug 10 13:44:37.008280 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Role: member,reader Aug 10 13:44:37.008280 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Roles: member,reader Aug 10 13:44:37.009876 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6f889848d459459484b5b5517fef576b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6f889848d459459484b5b5517fef576b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6f889848d459459484b5b5517fef576b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6f889848d459459484b5b5517fef576b"}]}] Aug 10 13:44:37.009876 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant: tempest-AttachVolumeTestJSON-1472892946 Aug 10 13:44:37.009876 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Id: 6f889848d459459484b5b5517fef576b Aug 10 13:44:37.009876 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1472892946 Aug 10 13:44:37.009876 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User: tempest-AttachVolumeTestJSON-1472892946-project Aug 10 13:44:37.009876 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Id: default Aug 10 13:44:37.009876 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Name: Default Aug 10 13:44:37.009876 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Id: 289c7d8b89cd445a924f5ac07e85fe48 Aug 10 13:44:37.009876 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Name: tempest-AttachVolumeTestJSON-1472892946-project Aug 10 13:44:37.009876 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: method: > Aug 10 13:44:37.009876 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: exception: Instance 3d30c2bb-a513-4a88-a9e4-3cf892bda262 could not be found. Aug 10 13:44:37.009876 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: action_args: {'id': '3d30c2bb-a513-4a88-a9e4-3cf892bda262'} Aug 10 13:44:37.010784 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:44:37.010784 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:37.010784 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:44:37.010784 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:44:37.010784 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:44:37.010784 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:44:37.010784 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:44:37.010784 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:44:37.010784 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:44:37.010784 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:44:37.010784 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d30c2bb-a513-4a88-a9e4-3cf892bda262 could not be found. Aug 10 13:44:37.010784 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:37.010784 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:44:37.010784 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:37.010784 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:37.010784 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:44:37.010784 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:44:37.010784 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:44:37.010784 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:44:37.010784 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:44:37.012216 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:44:37.012216 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 13:44:37.012216 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 13:44:37.012216 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 13:44:37.012216 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 13:44:37.012216 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:44:37.012216 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:44:37.012216 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:44:37.012216 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:44:37.012216 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d30c2bb-a513-4a88-a9e4-3cf892bda262 could not be found. Aug 10 13:44:37.012216 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:37.012216 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:44:37.012216 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:37.012216 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:37.012216 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:44:37.012216 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:44:37.012216 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:44:37.012216 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:44:37.012216 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d30c2bb-a513-4a88-a9e4-3cf892bda262 could not be found. Aug 10 13:44:37.012216 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:37.013763 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-6c7a6625-b6bf-4c72-b14e-2cf6af95e174 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Returning 404 to user: Instance 3d30c2bb-a513-4a88-a9e4-3cf892bda262 could not be found. {{(pid=129523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:44:37.013763 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-6c7a6625-b6bf-4c72-b14e-2cf6af95e174 tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262" status: 404 len: 111 microversion: 2.1 time: 0.030784 Aug 10 13:44:37.013763 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 430/886] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 10 13:44:36 2022] DELETE /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:44:37.018644 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-2dd6a411-47fb-4a4c-a960-fea8911091fe tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:37.019259 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-2dd6a411-47fb-4a4c-a960-fea8911091fe tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 3d30c2bb-a513-4a88-a9e4-3cf892bda262] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:37.025339 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2dd6a411-47fb-4a4c-a960-fea8911091fe tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:37.025824 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2dd6a411-47fb-4a4c-a960-fea8911091fe tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:37.026259 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2dd6a411-47fb-4a4c-a960-fea8911091fe tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:37.026949 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2dd6a411-47fb-4a4c-a960-fea8911091fe tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:37.027407 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2dd6a411-47fb-4a4c-a960-fea8911091fe tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:37.027830 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2dd6a411-47fb-4a4c-a960-fea8911091fe tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:37.044327 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.wsgi [None req-2dd6a411-47fb-4a4c-a960-fea8911091fe tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] HTTP exception thrown: Instance 3d30c2bb-a513-4a88-a9e4-3cf892bda262 could not be found. Aug 10 13:44:37.046213 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-2dd6a411-47fb-4a4c-a960-fea8911091fe tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Request method failure captured: Aug 10 13:44:37.046213 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: request: GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262 HTTP/1.1 Aug 10 13:44:37.046213 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept: application/json Aug 10 13:44:37.046213 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept-Encoding: identity Aug 10 13:44:37.046213 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Connection: close Aug 10 13:44:37.046213 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Length: 0 Aug 10 13:44:37.046213 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Type: application/json Aug 10 13:44:37.046213 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Host: 10.222.0.52 Aug 10 13:44:37.046213 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Openstack-System-Scope: None Aug 10 13:44:37.046213 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: User-Agent: python-urllib3/1.26.11 Aug 10 13:44:37.046213 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Auth-Token: gAAAAABi87SyBFBTkzIY0ISubWBiCPDiFQUyewnxnl7oGdfB5bLCdvtusNqIu_rxLiQmzA10NW-oLYnxkPKTRJxOWt6GCY4FSu918nxANV0rrJqErzPZFzHVcO3Q7M6u16ou_0R64Gx1Pk4MSTjnQcksYaErDaz6zlJQY8VAw20k3gMYZDkoYKE Aug 10 13:44:37.046213 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Id: None Aug 10 13:44:37.046213 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Name: None Aug 10 13:44:37.046213 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Identity-Status: Confirmed Aug 10 13:44:37.046213 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Is-Admin-Project: True Aug 10 13:44:37.046213 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Id: default Aug 10 13:44:37.046213 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Name: Default Aug 10 13:44:37.046213 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Id: 6f889848d459459484b5b5517fef576b Aug 10 13:44:37.046213 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Name: tempest-AttachVolumeTestJSON-1472892946 Aug 10 13:44:37.046213 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Role: member,reader Aug 10 13:44:37.046213 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Roles: member,reader Aug 10 13:44:37.047791 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6f889848d459459484b5b5517fef576b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6f889848d459459484b5b5517fef576b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6f889848d459459484b5b5517fef576b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6f889848d459459484b5b5517fef576b"}]}] Aug 10 13:44:37.047791 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant: tempest-AttachVolumeTestJSON-1472892946 Aug 10 13:44:37.047791 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Id: 6f889848d459459484b5b5517fef576b Aug 10 13:44:37.047791 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1472892946 Aug 10 13:44:37.047791 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User: tempest-AttachVolumeTestJSON-1472892946-project Aug 10 13:44:37.047791 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Id: default Aug 10 13:44:37.047791 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Name: Default Aug 10 13:44:37.047791 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Id: 289c7d8b89cd445a924f5ac07e85fe48 Aug 10 13:44:37.047791 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Name: tempest-AttachVolumeTestJSON-1472892946-project Aug 10 13:44:37.047791 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: method: > Aug 10 13:44:37.047791 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: exception: Instance 3d30c2bb-a513-4a88-a9e4-3cf892bda262 could not be found. Aug 10 13:44:37.047791 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: action_args: {'id': '3d30c2bb-a513-4a88-a9e4-3cf892bda262'} Aug 10 13:44:37.048717 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:44:37.048717 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:37.048717 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:44:37.048717 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:44:37.048717 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:44:37.048717 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:44:37.048717 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:44:37.048717 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:44:37.048717 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:44:37.048717 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:44:37.048717 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d30c2bb-a513-4a88-a9e4-3cf892bda262 could not be found. Aug 10 13:44:37.048717 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:44:37.048717 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:44:37.048717 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:44:37.048717 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:37.048717 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:44:37.048717 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:44:37.048717 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:44:37.048717 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:44:37.048717 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:44:37.050441 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:44:37.050441 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:44:37.050441 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:44:37.050441 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:44:37.050441 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:44:37.050441 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:44:37.050441 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:44:37.050441 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d30c2bb-a513-4a88-a9e4-3cf892bda262 could not be found. Aug 10 13:44:37.050441 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:44:37.050441 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:44:37.050441 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:44:37.050441 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:37.050441 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:44:37.050441 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:44:37.050441 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:44:37.050441 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:44:37.050441 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d30c2bb-a513-4a88-a9e4-3cf892bda262 could not be found. Aug 10 13:44:37.050441 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:44:37.051826 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-2dd6a411-47fb-4a4c-a960-fea8911091fe tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Returning 404 to user: Instance 3d30c2bb-a513-4a88-a9e4-3cf892bda262 could not be found. {{(pid=129522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:44:37.051826 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-2dd6a411-47fb-4a4c-a960-fea8911091fe tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262" status: 404 len: 111 microversion: 2.1 time: 0.033161 Aug 10 13:44:37.051826 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 457/887] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:44:37 2022] GET /compute/v2.1/servers/3d30c2bb-a513-4a88-a9e4-3cf892bda262 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:44:37.259821 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-b1911712-d846-41de-b74e-7a8073f33fa3 req-9153d7b8-f1e8-440a-b0f8-199b7e127e0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52cd9b3e-aa05-41f0-b17a-d78f06e5d176", "name": "network-vif-plugged", "status": "completed", "tag": "3874b623-0ac2-47e5-88e0-78f207e051a4"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:44:37.275035 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-b1911712-d846-41de-b74e-7a8073f33fa3 req-9153d7b8-f1e8-440a-b0f8-199b7e127e0c service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:37.275677 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-b1911712-d846-41de-b74e-7a8073f33fa3 req-9153d7b8-f1e8-440a-b0f8-199b7e127e0c service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:37.276379 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-b1911712-d846-41de-b74e-7a8073f33fa3 req-9153d7b8-f1e8-440a-b0f8-199b7e127e0c service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:37.294413 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-b1911712-d846-41de-b74e-7a8073f33fa3 req-9153d7b8-f1e8-440a-b0f8-199b7e127e0c service nova] Creating event network-vif-plugged:3874b623-0ac2-47e5-88e0-78f207e051a4 for instance 52cd9b3e-aa05-41f0-b17a-d78f06e5d176 on hv-cinder-85200 Aug 10 13:44:37.301110 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-b1911712-d846-41de-b74e-7a8073f33fa3 req-9153d7b8-f1e8-440a-b0f8-199b7e127e0c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048523 Aug 10 13:44:37.302836 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 431/888] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:44:37.306386 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-a17c7da4-e710-4f43-bb4d-7980106f9d46 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:37.307008 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-a17c7da4-e710-4f43-bb4d-7980106f9d46 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:37.313937 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a17c7da4-e710-4f43-bb4d-7980106f9d46 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:37.314745 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a17c7da4-e710-4f43-bb4d-7980106f9d46 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:37.315179 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a17c7da4-e710-4f43-bb4d-7980106f9d46 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:37.315894 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a17c7da4-e710-4f43-bb4d-7980106f9d46 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:37.316412 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a17c7da4-e710-4f43-bb4d-7980106f9d46 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:37.316928 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a17c7da4-e710-4f43-bb4d-7980106f9d46 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:37.515775 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-a17c7da4-e710-4f43-bb4d-7980106f9d46 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:37.524017 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-a17c7da4-e710-4f43-bb4d-7980106f9d46 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1265 microversion: 2.1 time: 0.222510 Aug 10 13:44:37.524560 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 458/889] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:44:37 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1265 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:44:38.213022 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-3c5cb67f-7152-4713-8e7e-a36395566d9e tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:38.213655 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-3c5cb67f-7152-4713-8e7e-a36395566d9e tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:38.219820 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3c5cb67f-7152-4713-8e7e-a36395566d9e tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:38.220307 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3c5cb67f-7152-4713-8e7e-a36395566d9e tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:38.220737 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3c5cb67f-7152-4713-8e7e-a36395566d9e tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:38.221459 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3c5cb67f-7152-4713-8e7e-a36395566d9e tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:38.222026 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3c5cb67f-7152-4713-8e7e-a36395566d9e tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:38.222449 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3c5cb67f-7152-4713-8e7e-a36395566d9e tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:38.238260 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.wsgi [None req-3c5cb67f-7152-4713-8e7e-a36395566d9e tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] HTTP exception thrown: Instance 589498ff-2901-49e5-91c2-0275f4dcf522 could not be found. Aug 10 13:44:38.239870 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-3c5cb67f-7152-4713-8e7e-a36395566d9e tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Request method failure captured: Aug 10 13:44:38.239870 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: request: DELETE /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 HTTP/1.1 Aug 10 13:44:38.239870 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept: application/json Aug 10 13:44:38.239870 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept-Encoding: identity Aug 10 13:44:38.239870 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Connection: close Aug 10 13:44:38.239870 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Length: 0 Aug 10 13:44:38.239870 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Type: application/json Aug 10 13:44:38.239870 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Host: 10.222.0.52 Aug 10 13:44:38.239870 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Openstack-System-Scope: None Aug 10 13:44:38.239870 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: User-Agent: python-urllib3/1.26.11 Aug 10 13:44:38.239870 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Auth-Token: gAAAAABi87SyBFBTkzIY0ISubWBiCPDiFQUyewnxnl7oGdfB5bLCdvtusNqIu_rxLiQmzA10NW-oLYnxkPKTRJxOWt6GCY4FSu918nxANV0rrJqErzPZFzHVcO3Q7M6u16ou_0R64Gx1Pk4MSTjnQcksYaErDaz6zlJQY8VAw20k3gMYZDkoYKE Aug 10 13:44:38.239870 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Id: None Aug 10 13:44:38.239870 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Name: None Aug 10 13:44:38.239870 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Identity-Status: Confirmed Aug 10 13:44:38.239870 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Is-Admin-Project: True Aug 10 13:44:38.239870 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Id: default Aug 10 13:44:38.239870 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Name: Default Aug 10 13:44:38.239870 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Id: 6f889848d459459484b5b5517fef576b Aug 10 13:44:38.239870 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Name: tempest-AttachVolumeTestJSON-1472892946 Aug 10 13:44:38.239870 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Role: member,reader Aug 10 13:44:38.239870 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Roles: member,reader Aug 10 13:44:38.241543 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6f889848d459459484b5b5517fef576b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6f889848d459459484b5b5517fef576b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6f889848d459459484b5b5517fef576b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6f889848d459459484b5b5517fef576b"}]}] Aug 10 13:44:38.241543 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant: tempest-AttachVolumeTestJSON-1472892946 Aug 10 13:44:38.241543 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Id: 6f889848d459459484b5b5517fef576b Aug 10 13:44:38.241543 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1472892946 Aug 10 13:44:38.241543 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User: tempest-AttachVolumeTestJSON-1472892946-project Aug 10 13:44:38.241543 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Id: default Aug 10 13:44:38.241543 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Name: Default Aug 10 13:44:38.241543 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Id: 289c7d8b89cd445a924f5ac07e85fe48 Aug 10 13:44:38.241543 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Name: tempest-AttachVolumeTestJSON-1472892946-project Aug 10 13:44:38.241543 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: method: > Aug 10 13:44:38.241543 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: exception: Instance 589498ff-2901-49e5-91c2-0275f4dcf522 could not be found. Aug 10 13:44:38.241543 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: action_args: {'id': '589498ff-2901-49e5-91c2-0275f4dcf522'} Aug 10 13:44:38.242448 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:44:38.242448 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:38.242448 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:44:38.242448 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:44:38.242448 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:44:38.242448 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:44:38.242448 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:44:38.242448 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:44:38.242448 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:44:38.242448 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:44:38.242448 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 589498ff-2901-49e5-91c2-0275f4dcf522 could not be found. Aug 10 13:44:38.242448 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:38.242448 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:44:38.242448 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:38.242448 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:38.242448 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:44:38.242448 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:44:38.242448 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:44:38.242448 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:44:38.242448 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:44:38.243914 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:44:38.243914 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 13:44:38.243914 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 13:44:38.243914 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 13:44:38.243914 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 13:44:38.243914 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:44:38.243914 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:44:38.243914 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:44:38.243914 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:44:38.243914 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 589498ff-2901-49e5-91c2-0275f4dcf522 could not be found. Aug 10 13:44:38.243914 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:38.243914 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:44:38.243914 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:38.243914 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:38.243914 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:44:38.243914 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:44:38.243914 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:44:38.243914 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:44:38.243914 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 589498ff-2901-49e5-91c2-0275f4dcf522 could not be found. Aug 10 13:44:38.243914 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:38.245395 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-3c5cb67f-7152-4713-8e7e-a36395566d9e tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Returning 404 to user: Instance 589498ff-2901-49e5-91c2-0275f4dcf522 could not be found. {{(pid=129523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:44:38.245395 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-3c5cb67f-7152-4713-8e7e-a36395566d9e tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "DELETE /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 404 len: 111 microversion: 2.1 time: 0.032522 Aug 10 13:44:38.245395 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 432/890] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 10 13:44:38 2022] DELETE /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:44:38.250585 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-b7c28b50-59a9-47b3-b471-33a5b9034fea tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:38.251202 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-b7c28b50-59a9-47b3-b471-33a5b9034fea tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] [instance: 589498ff-2901-49e5-91c2-0275f4dcf522] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:38.257789 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b7c28b50-59a9-47b3-b471-33a5b9034fea tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:38.258276 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b7c28b50-59a9-47b3-b471-33a5b9034fea tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:38.258712 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b7c28b50-59a9-47b3-b471-33a5b9034fea tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:38.259408 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b7c28b50-59a9-47b3-b471-33a5b9034fea tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:38.259865 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b7c28b50-59a9-47b3-b471-33a5b9034fea tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:38.260289 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b7c28b50-59a9-47b3-b471-33a5b9034fea tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:38.275087 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.wsgi [None req-b7c28b50-59a9-47b3-b471-33a5b9034fea tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] HTTP exception thrown: Instance 589498ff-2901-49e5-91c2-0275f4dcf522 could not be found. Aug 10 13:44:38.276685 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-b7c28b50-59a9-47b3-b471-33a5b9034fea tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Request method failure captured: Aug 10 13:44:38.276685 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: request: GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 HTTP/1.1 Aug 10 13:44:38.276685 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept: application/json Aug 10 13:44:38.276685 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept-Encoding: identity Aug 10 13:44:38.276685 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Connection: close Aug 10 13:44:38.276685 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Length: 0 Aug 10 13:44:38.276685 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Type: application/json Aug 10 13:44:38.276685 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Host: 10.222.0.52 Aug 10 13:44:38.276685 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Openstack-System-Scope: None Aug 10 13:44:38.276685 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: User-Agent: python-urllib3/1.26.11 Aug 10 13:44:38.276685 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Auth-Token: gAAAAABi87SyBFBTkzIY0ISubWBiCPDiFQUyewnxnl7oGdfB5bLCdvtusNqIu_rxLiQmzA10NW-oLYnxkPKTRJxOWt6GCY4FSu918nxANV0rrJqErzPZFzHVcO3Q7M6u16ou_0R64Gx1Pk4MSTjnQcksYaErDaz6zlJQY8VAw20k3gMYZDkoYKE Aug 10 13:44:38.276685 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Id: None Aug 10 13:44:38.276685 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Name: None Aug 10 13:44:38.276685 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Identity-Status: Confirmed Aug 10 13:44:38.276685 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Is-Admin-Project: True Aug 10 13:44:38.276685 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Id: default Aug 10 13:44:38.276685 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Name: Default Aug 10 13:44:38.276685 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Id: 6f889848d459459484b5b5517fef576b Aug 10 13:44:38.276685 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Name: tempest-AttachVolumeTestJSON-1472892946 Aug 10 13:44:38.276685 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Role: member,reader Aug 10 13:44:38.276685 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Roles: member,reader Aug 10 13:44:38.278861 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6f889848d459459484b5b5517fef576b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6f889848d459459484b5b5517fef576b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6f889848d459459484b5b5517fef576b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6f889848d459459484b5b5517fef576b"}]}] Aug 10 13:44:38.278861 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant: tempest-AttachVolumeTestJSON-1472892946 Aug 10 13:44:38.278861 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Id: 6f889848d459459484b5b5517fef576b Aug 10 13:44:38.278861 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1472892946 Aug 10 13:44:38.278861 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User: tempest-AttachVolumeTestJSON-1472892946-project Aug 10 13:44:38.278861 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Id: default Aug 10 13:44:38.278861 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Name: Default Aug 10 13:44:38.278861 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Id: 289c7d8b89cd445a924f5ac07e85fe48 Aug 10 13:44:38.278861 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Name: tempest-AttachVolumeTestJSON-1472892946-project Aug 10 13:44:38.278861 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: method: > Aug 10 13:44:38.278861 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: exception: Instance 589498ff-2901-49e5-91c2-0275f4dcf522 could not be found. Aug 10 13:44:38.278861 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: action_args: {'id': '589498ff-2901-49e5-91c2-0275f4dcf522'} Aug 10 13:44:38.280059 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:44:38.280059 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:38.280059 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:44:38.280059 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:44:38.280059 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:44:38.280059 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:44:38.280059 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:44:38.280059 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:44:38.280059 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:44:38.280059 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:44:38.280059 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 589498ff-2901-49e5-91c2-0275f4dcf522 could not be found. Aug 10 13:44:38.280059 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:44:38.280059 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:44:38.280059 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:44:38.280059 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:38.280059 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:44:38.280059 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:44:38.280059 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:44:38.280059 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:44:38.280059 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:44:38.282248 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:44:38.282248 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:44:38.282248 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:44:38.282248 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:44:38.282248 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:44:38.282248 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:44:38.282248 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:44:38.282248 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 589498ff-2901-49e5-91c2-0275f4dcf522 could not be found. Aug 10 13:44:38.282248 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:44:38.282248 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:44:38.282248 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:44:38.282248 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:38.282248 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:44:38.282248 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:44:38.282248 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:44:38.282248 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:44:38.282248 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 589498ff-2901-49e5-91c2-0275f4dcf522 could not be found. Aug 10 13:44:38.282248 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:44:38.284430 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-b7c28b50-59a9-47b3-b471-33a5b9034fea tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] Returning 404 to user: Instance 589498ff-2901-49e5-91c2-0275f4dcf522 could not be found. {{(pid=129522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:44:38.284430 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-b7c28b50-59a9-47b3-b471-33a5b9034fea tempest-AttachVolumeTestJSON-1472892946 tempest-AttachVolumeTestJSON-1472892946-project] 10.222.0.52 "GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522" status: 404 len: 111 microversion: 2.1 time: 0.032069 Aug 10 13:44:38.284430 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 459/891] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:44:38 2022] GET /compute/v2.1/servers/589498ff-2901-49e5-91c2-0275f4dcf522 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:44:38.544843 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-1571292d-761e-4df1-aed4-5ad905abec74 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:38.545585 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-1571292d-761e-4df1-aed4-5ad905abec74 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:38.552548 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1571292d-761e-4df1-aed4-5ad905abec74 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:38.553049 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1571292d-761e-4df1-aed4-5ad905abec74 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:38.553545 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1571292d-761e-4df1-aed4-5ad905abec74 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:38.554257 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1571292d-761e-4df1-aed4-5ad905abec74 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:38.554751 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1571292d-761e-4df1-aed4-5ad905abec74 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:38.555212 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1571292d-761e-4df1-aed4-5ad905abec74 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:38.781369 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-1571292d-761e-4df1-aed4-5ad905abec74 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:38.792462 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-1571292d-761e-4df1-aed4-5ad905abec74 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1265 microversion: 2.1 time: 0.251068 Aug 10 13:44:38.793784 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 433/892] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:44:38 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1265 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:44:39.818523 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-6c3b6802-853b-453e-b5df-fe903c520020 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:39.819705 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-6c3b6802-853b-453e-b5df-fe903c520020 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:39.827175 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6c3b6802-853b-453e-b5df-fe903c520020 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:39.827675 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6c3b6802-853b-453e-b5df-fe903c520020 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:39.828116 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6c3b6802-853b-453e-b5df-fe903c520020 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:39.828845 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6c3b6802-853b-453e-b5df-fe903c520020 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:39.829331 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6c3b6802-853b-453e-b5df-fe903c520020 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:39.829760 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6c3b6802-853b-453e-b5df-fe903c520020 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:40.010193 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-6c3b6802-853b-453e-b5df-fe903c520020 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:40.019030 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-6c3b6802-853b-453e-b5df-fe903c520020 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1453 microversion: 2.1 time: 0.208991 Aug 10 13:44:40.019613 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 460/893] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:44:39 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1453 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:44:40.053159 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-38d31efe-20f7-4943-a3dd-85e5f7c1d46c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:40.053826 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-38d31efe-20f7-4943-a3dd-85e5f7c1d46c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:40.060799 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-38d31efe-20f7-4943-a3dd-85e5f7c1d46c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:40.061325 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-38d31efe-20f7-4943-a3dd-85e5f7c1d46c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:40.061768 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-38d31efe-20f7-4943-a3dd-85e5f7c1d46c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:40.062480 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-38d31efe-20f7-4943-a3dd-85e5f7c1d46c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:40.063115 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-38d31efe-20f7-4943-a3dd-85e5f7c1d46c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:40.063749 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-38d31efe-20f7-4943-a3dd-85e5f7c1d46c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:40.500964 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-38d31efe-20f7-4943-a3dd-85e5f7c1d46c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:40.514758 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-38d31efe-20f7-4943-a3dd-85e5f7c1d46c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1453 microversion: 2.1 time: 0.465720 Aug 10 13:44:40.520895 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 434/894] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:44:40 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1453 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:44:43.515147 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-a423e70e-adbd-4031-9416-66d351d8c13f req-4e05779b-956b-4eb8-9f70-089743c52554 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52cd9b3e-aa05-41f0-b17a-d78f06e5d176", "tag": "3874b623-0ac2-47e5-88e0-78f207e051a4"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:44:43.527002 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-a423e70e-adbd-4031-9416-66d351d8c13f req-4e05779b-956b-4eb8-9f70-089743c52554 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:43.527489 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-a423e70e-adbd-4031-9416-66d351d8c13f req-4e05779b-956b-4eb8-9f70-089743c52554 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:43.528413 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-a423e70e-adbd-4031-9416-66d351d8c13f req-4e05779b-956b-4eb8-9f70-089743c52554 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:43.541788 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-a423e70e-adbd-4031-9416-66d351d8c13f req-4e05779b-956b-4eb8-9f70-089743c52554 service nova] Creating event network-changed:3874b623-0ac2-47e5-88e0-78f207e051a4 for instance 52cd9b3e-aa05-41f0-b17a-d78f06e5d176 on hv-cinder-85200 Aug 10 13:44:43.547975 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-a423e70e-adbd-4031-9416-66d351d8c13f req-4e05779b-956b-4eb8-9f70-089743c52554 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.260192 Aug 10 13:44:43.549305 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 461/895] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:44:47.312609 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-e2d4704f-39fb-4af9-bf27-5a51db745ff8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:47.314732 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-e2d4704f-39fb-4af9-bf27-5a51db745ff8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:47.321464 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e2d4704f-39fb-4af9-bf27-5a51db745ff8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:47.321957 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e2d4704f-39fb-4af9-bf27-5a51db745ff8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:47.322755 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e2d4704f-39fb-4af9-bf27-5a51db745ff8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:47.323093 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e2d4704f-39fb-4af9-bf27-5a51db745ff8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:47.323545 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e2d4704f-39fb-4af9-bf27-5a51db745ff8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:47.323969 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e2d4704f-39fb-4af9-bf27-5a51db745ff8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:47.354286 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-e2d4704f-39fb-4af9-bf27-5a51db745ff8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045491 Aug 10 13:44:47.354773 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 435/896] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Aug 10 13:44:47 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:44:47.420968 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-e8f0cfde-c4f4-4930-a186-754f8196a3d8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:47.421585 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-e8f0cfde-c4f4-4930-a186-754f8196a3d8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:47.427573 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e8f0cfde-c4f4-4930-a186-754f8196a3d8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:47.428054 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e8f0cfde-c4f4-4930-a186-754f8196a3d8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:47.428492 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e8f0cfde-c4f4-4930-a186-754f8196a3d8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:47.429181 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e8f0cfde-c4f4-4930-a186-754f8196a3d8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:47.429663 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e8f0cfde-c4f4-4930-a186-754f8196a3d8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:47.430089 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e8f0cfde-c4f4-4930-a186-754f8196a3d8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:47.456353 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-e8f0cfde-c4f4-4930-a186-754f8196a3d8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Going to try to terminate instance {{(pid=129522) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:44:47.536247 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-e8f0cfde-c4f4-4930-a186-754f8196a3d8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 204 len: 0 microversion: 2.20 time: 0.120337 Aug 10 13:44:47.536803 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 462/897] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Aug 10 13:44:47 2022] DELETE /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 13:44:47.545021 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-1c630d3a-af76-4268-a8d5-c4bf4de5c218 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:47.545665 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-1c630d3a-af76-4268-a8d5-c4bf4de5c218 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:47.551844 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1c630d3a-af76-4268-a8d5-c4bf4de5c218 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:47.552334 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1c630d3a-af76-4268-a8d5-c4bf4de5c218 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:47.552773 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1c630d3a-af76-4268-a8d5-c4bf4de5c218 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:47.553497 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1c630d3a-af76-4268-a8d5-c4bf4de5c218 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:47.553958 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1c630d3a-af76-4268-a8d5-c4bf4de5c218 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:47.554393 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1c630d3a-af76-4268-a8d5-c4bf4de5c218 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:47.559306 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:44:47.697287 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-1c630d3a-af76-4268-a8d5-c4bf4de5c218 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:47.706733 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-1c630d3a-af76-4268-a8d5-c4bf4de5c218 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:47.708522 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-1c630d3a-af76-4268-a8d5-c4bf4de5c218 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:47.713275 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-1c630d3a-af76-4268-a8d5-c4bf4de5c218 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1722 microversion: 2.20 time: 0.168905 Aug 10 13:44:47.713275 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 436/898] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:44:47 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:44:48.736328 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-5d48e764-cf8d-40fe-b49d-9678589e4aa4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:48.737031 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-5d48e764-cf8d-40fe-b49d-9678589e4aa4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:48.743655 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5d48e764-cf8d-40fe-b49d-9678589e4aa4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:48.744142 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5d48e764-cf8d-40fe-b49d-9678589e4aa4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:48.744578 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5d48e764-cf8d-40fe-b49d-9678589e4aa4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:48.745296 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5d48e764-cf8d-40fe-b49d-9678589e4aa4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:48.745844 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5d48e764-cf8d-40fe-b49d-9678589e4aa4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:48.746702 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5d48e764-cf8d-40fe-b49d-9678589e4aa4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:48.897170 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-5d48e764-cf8d-40fe-b49d-9678589e4aa4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:48.906815 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-5d48e764-cf8d-40fe-b49d-9678589e4aa4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:48.908509 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-5d48e764-cf8d-40fe-b49d-9678589e4aa4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:48.909759 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-5d48e764-cf8d-40fe-b49d-9678589e4aa4 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1722 microversion: 2.20 time: 0.177645 Aug 10 13:44:48.910445 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 463/899] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:44:48 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:44:49.933066 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-a0029435-2686-4ea2-98ee-df0bcfdec1be tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:49.933840 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-a0029435-2686-4ea2-98ee-df0bcfdec1be tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:49.940597 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a0029435-2686-4ea2-98ee-df0bcfdec1be tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:49.941077 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a0029435-2686-4ea2-98ee-df0bcfdec1be tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:49.941537 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a0029435-2686-4ea2-98ee-df0bcfdec1be tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:49.942252 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a0029435-2686-4ea2-98ee-df0bcfdec1be tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:49.942698 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a0029435-2686-4ea2-98ee-df0bcfdec1be tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:49.943115 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a0029435-2686-4ea2-98ee-df0bcfdec1be tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:50.070179 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-a0029435-2686-4ea2-98ee-df0bcfdec1be tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:50.078065 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-a0029435-2686-4ea2-98ee-df0bcfdec1be tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:50.079574 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-a0029435-2686-4ea2-98ee-df0bcfdec1be tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:50.080742 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-a0029435-2686-4ea2-98ee-df0bcfdec1be tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1722 microversion: 2.20 time: 0.151947 Aug 10 13:44:50.081448 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 437/900] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:44:49 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:44:51.104087 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-c8bf9a0d-b576-4267-9477-27346358d3f7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:51.104698 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-c8bf9a0d-b576-4267-9477-27346358d3f7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:51.111757 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c8bf9a0d-b576-4267-9477-27346358d3f7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:51.112236 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c8bf9a0d-b576-4267-9477-27346358d3f7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:51.112668 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c8bf9a0d-b576-4267-9477-27346358d3f7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:51.113670 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c8bf9a0d-b576-4267-9477-27346358d3f7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:51.114122 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c8bf9a0d-b576-4267-9477-27346358d3f7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:51.114542 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c8bf9a0d-b576-4267-9477-27346358d3f7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:51.117189 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=96,nova_cell1:UPDATE=1 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:44:51.252097 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-c8bf9a0d-b576-4267-9477-27346358d3f7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:51.260453 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-c8bf9a0d-b576-4267-9477-27346358d3f7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:51.262497 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-c8bf9a0d-b576-4267-9477-27346358d3f7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:51.263673 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-c8bf9a0d-b576-4267-9477-27346358d3f7 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1722 microversion: 2.20 time: 0.163463 Aug 10 13:44:51.264232 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 464/901] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:44:51 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:44:52.286328 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-b3530bd6-4a33-4d38-8ccf-a3e4e9bfc36d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:52.286937 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-b3530bd6-4a33-4d38-8ccf-a3e4e9bfc36d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:52.289280 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:44:52.295268 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b3530bd6-4a33-4d38-8ccf-a3e4e9bfc36d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:52.295960 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b3530bd6-4a33-4d38-8ccf-a3e4e9bfc36d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:52.296594 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b3530bd6-4a33-4d38-8ccf-a3e4e9bfc36d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:52.297308 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b3530bd6-4a33-4d38-8ccf-a3e4e9bfc36d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:52.297922 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b3530bd6-4a33-4d38-8ccf-a3e4e9bfc36d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:52.298890 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b3530bd6-4a33-4d38-8ccf-a3e4e9bfc36d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:52.380213 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-b3530bd6-4a33-4d38-8ccf-a3e4e9bfc36d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:52.395866 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-b3530bd6-4a33-4d38-8ccf-a3e4e9bfc36d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:52.400932 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-b3530bd6-4a33-4d38-8ccf-a3e4e9bfc36d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cecae4323404bd29fe8c05a704de273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cfb6539b69493ebef06cf7176b1935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:44:52.402184 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-b3530bd6-4a33-4d38-8ccf-a3e4e9bfc36d tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 200 len: 1654 microversion: 2.20 time: 0.119705 Aug 10 13:44:52.403689 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 438/902] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:44:52 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 1654 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:44:52.837946 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-06b0ca64-0d40-4559-be68-11ef60bb84ab req-bab85d60-702c-4e8e-a16a-69459a79fd75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa512f7-4b23-46bf-aa72-a3f72f2e122f", "name": "network-vif-deleted", "tag": "1c042378-ea6a-4e4d-a088-c806fdfbe4e9"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:44:52.863552 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-06b0ca64-0d40-4559-be68-11ef60bb84ab req-bab85d60-702c-4e8e-a16a-69459a79fd75 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:52.864129 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-06b0ca64-0d40-4559-be68-11ef60bb84ab req-bab85d60-702c-4e8e-a16a-69459a79fd75 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:52.864557 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-06b0ca64-0d40-4559-be68-11ef60bb84ab req-bab85d60-702c-4e8e-a16a-69459a79fd75 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:52.878293 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-06b0ca64-0d40-4559-be68-11ef60bb84ab req-bab85d60-702c-4e8e-a16a-69459a79fd75 service nova] Creating event network-vif-deleted:1c042378-ea6a-4e4d-a088-c806fdfbe4e9 for instance 3aa512f7-4b23-46bf-aa72-a3f72f2e122f on hv-cinder-85200 Aug 10 13:44:52.885046 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-06b0ca64-0d40-4559-be68-11ef60bb84ab req-bab85d60-702c-4e8e-a16a-69459a79fd75 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053992 Aug 10 13:44:52.886156 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 465/903] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:44:53.426907 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-5f89b1e4-f29e-4fde-9db2-84d42c466389 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:53.428102 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-5f89b1e4-f29e-4fde-9db2-84d42c466389 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:53.434378 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5f89b1e4-f29e-4fde-9db2-84d42c466389 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:53.434867 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5f89b1e4-f29e-4fde-9db2-84d42c466389 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:53.435465 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5f89b1e4-f29e-4fde-9db2-84d42c466389 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:53.436471 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5f89b1e4-f29e-4fde-9db2-84d42c466389 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:53.436927 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5f89b1e4-f29e-4fde-9db2-84d42c466389 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:53.437445 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-5f89b1e4-f29e-4fde-9db2-84d42c466389 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:53.451745 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.wsgi [None req-5f89b1e4-f29e-4fde-9db2-84d42c466389 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] HTTP exception thrown: Instance 3aa512f7-4b23-46bf-aa72-a3f72f2e122f could not be found. Aug 10 13:44:53.453305 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-5f89b1e4-f29e-4fde-9db2-84d42c466389 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Request method failure captured: Aug 10 13:44:53.453305 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: request: GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f HTTP/1.1 Aug 10 13:44:53.453305 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept: application/json Aug 10 13:44:53.453305 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept-Encoding: identity Aug 10 13:44:53.453305 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Connection: close Aug 10 13:44:53.453305 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Length: 0 Aug 10 13:44:53.453305 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Type: application/json Aug 10 13:44:53.453305 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Host: 10.222.0.52 Aug 10 13:44:53.453305 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Openstack-System-Scope: None Aug 10 13:44:53.453305 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: User-Agent: python-urllib3/1.26.11 Aug 10 13:44:53.453305 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Auth-Token: gAAAAABi87SjyxddKhUB7OUwPME21JMZGNdpbtCe9Qe7UZOBNnEqoMdGpeDVGCtahrN9iVRiXf3MBCGKxvt5ZDHVakZChOWNOR7x8LO7HCcoNIIwyXtoZlQ5CvJl1zAp5Hh5JeQRi8YGR91f8U8cbGHkEUbpcOG2SjLXruf_gDYc1HnXb6IZMDs Aug 10 13:44:53.453305 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Id: None Aug 10 13:44:53.453305 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Name: None Aug 10 13:44:53.453305 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Identity-Status: Confirmed Aug 10 13:44:53.453305 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Is-Admin-Project: True Aug 10 13:44:53.453305 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 13:44:53.453305 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Id: default Aug 10 13:44:53.453305 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Name: Default Aug 10 13:44:53.453305 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Id: b6cfb6539b69493ebef06cf7176b1935 Aug 10 13:44:53.453305 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-854584124 Aug 10 13:44:53.453305 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Role: member,reader Aug 10 13:44:53.453305 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Roles: member,reader Aug 10 13:44:53.454908 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b6cfb6539b69493ebef06cf7176b1935"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b6cfb6539b69493ebef06cf7176b1935"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b6cfb6539b69493ebef06cf7176b1935", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b6cfb6539b69493ebef06cf7176b1935"}]}] Aug 10 13:44:53.454908 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant: tempest-AttachVolumeShelveTestJSON-854584124 Aug 10 13:44:53.454908 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Id: b6cfb6539b69493ebef06cf7176b1935 Aug 10 13:44:53.454908 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-854584124 Aug 10 13:44:53.454908 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User: tempest-AttachVolumeShelveTestJSON-854584124-project Aug 10 13:44:53.454908 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Id: default Aug 10 13:44:53.454908 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Name: Default Aug 10 13:44:53.454908 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Id: 9cecae4323404bd29fe8c05a704de273 Aug 10 13:44:53.454908 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Name: tempest-AttachVolumeShelveTestJSON-854584124-project Aug 10 13:44:53.454908 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: method: > Aug 10 13:44:53.454908 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: exception: Instance 3aa512f7-4b23-46bf-aa72-a3f72f2e122f could not be found. Aug 10 13:44:53.454908 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: action_args: {'id': '3aa512f7-4b23-46bf-aa72-a3f72f2e122f'} Aug 10 13:44:53.459622 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:44:53.459622 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:53.459622 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:44:53.459622 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:44:53.459622 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:44:53.459622 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:44:53.459622 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:44:53.459622 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:44:53.459622 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:44:53.459622 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:44:53.459622 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aa512f7-4b23-46bf-aa72-a3f72f2e122f could not be found. Aug 10 13:44:53.459622 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:53.459622 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:44:53.459622 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:53.459622 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:53.459622 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:44:53.459622 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:44:53.459622 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:44:53.459622 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:44:53.459622 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:44:53.461038 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:44:53.461038 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:44:53.461038 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:44:53.461038 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:44:53.461038 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:44:53.461038 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:44:53.461038 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:44:53.461038 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aa512f7-4b23-46bf-aa72-a3f72f2e122f could not be found. Aug 10 13:44:53.461038 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:53.461038 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:44:53.461038 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:53.461038 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:53.461038 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:44:53.461038 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:44:53.461038 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:44:53.461038 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:44:53.461038 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aa512f7-4b23-46bf-aa72-a3f72f2e122f could not be found. Aug 10 13:44:53.461038 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:53.462414 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-5f89b1e4-f29e-4fde-9db2-84d42c466389 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Returning 404 to user: Instance 3aa512f7-4b23-46bf-aa72-a3f72f2e122f could not be found. {{(pid=129523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:44:53.462414 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-5f89b1e4-f29e-4fde-9db2-84d42c466389 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 404 len: 111 microversion: 2.20 time: 0.031830 Aug 10 13:44:53.462414 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 439/904] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:44:53 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 10 13:44:53.464313 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-db3c51a6-5f1b-45ac-9e81-daf5dc5f35be tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '.version_select at 0x7f49c45b50d0>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:53.483243 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-db3c51a6-5f1b-45ac-9e81-daf5dc5f35be tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1410104779" status: 204 len: 0 microversion: 2.20 time: 0.023172 Aug 10 13:44:53.484010 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 466/905] 10.222.0.52 () {60 vars in 1262 bytes} [Wed Aug 10 13:44:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1410104779 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 10 13:44:55.363975 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-74c92798-a1b3-4b25-87fb-4f36304ce369 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:55.364839 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-74c92798-a1b3-4b25-87fb-4f36304ce369 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:55.376031 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-74c92798-a1b3-4b25-87fb-4f36304ce369 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:55.376913 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-74c92798-a1b3-4b25-87fb-4f36304ce369 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:55.377768 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-74c92798-a1b3-4b25-87fb-4f36304ce369 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:55.378981 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-74c92798-a1b3-4b25-87fb-4f36304ce369 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:55.379781 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-74c92798-a1b3-4b25-87fb-4f36304ce369 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:55.380561 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-74c92798-a1b3-4b25-87fb-4f36304ce369 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:55.407536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.wsgi [None req-74c92798-a1b3-4b25-87fb-4f36304ce369 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] HTTP exception thrown: Instance 3aa512f7-4b23-46bf-aa72-a3f72f2e122f could not be found. Aug 10 13:44:55.409120 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-74c92798-a1b3-4b25-87fb-4f36304ce369 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Request method failure captured: Aug 10 13:44:55.409120 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: request: DELETE /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f HTTP/1.1 Aug 10 13:44:55.409120 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept: application/json Aug 10 13:44:55.409120 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept-Encoding: identity Aug 10 13:44:55.409120 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Connection: close Aug 10 13:44:55.409120 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Length: 0 Aug 10 13:44:55.409120 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Type: application/json Aug 10 13:44:55.409120 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Host: 10.222.0.52 Aug 10 13:44:55.409120 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Openstack-System-Scope: None Aug 10 13:44:55.409120 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: User-Agent: python-urllib3/1.26.11 Aug 10 13:44:55.409120 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Auth-Token: gAAAAABi87SjyxddKhUB7OUwPME21JMZGNdpbtCe9Qe7UZOBNnEqoMdGpeDVGCtahrN9iVRiXf3MBCGKxvt5ZDHVakZChOWNOR7x8LO7HCcoNIIwyXtoZlQ5CvJl1zAp5Hh5JeQRi8YGR91f8U8cbGHkEUbpcOG2SjLXruf_gDYc1HnXb6IZMDs Aug 10 13:44:55.409120 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Id: None Aug 10 13:44:55.409120 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Name: None Aug 10 13:44:55.409120 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Identity-Status: Confirmed Aug 10 13:44:55.409120 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Is-Admin-Project: True Aug 10 13:44:55.409120 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 13:44:55.409120 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Id: default Aug 10 13:44:55.409120 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Name: Default Aug 10 13:44:55.409120 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Id: b6cfb6539b69493ebef06cf7176b1935 Aug 10 13:44:55.409120 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-854584124 Aug 10 13:44:55.409120 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Role: member,reader Aug 10 13:44:55.409120 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Roles: member,reader Aug 10 13:44:55.410744 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b6cfb6539b69493ebef06cf7176b1935"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b6cfb6539b69493ebef06cf7176b1935"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b6cfb6539b69493ebef06cf7176b1935", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b6cfb6539b69493ebef06cf7176b1935"}]}] Aug 10 13:44:55.410744 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant: tempest-AttachVolumeShelveTestJSON-854584124 Aug 10 13:44:55.410744 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Id: b6cfb6539b69493ebef06cf7176b1935 Aug 10 13:44:55.410744 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-854584124 Aug 10 13:44:55.410744 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User: tempest-AttachVolumeShelveTestJSON-854584124-project Aug 10 13:44:55.410744 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Id: default Aug 10 13:44:55.410744 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Name: Default Aug 10 13:44:55.410744 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Id: 9cecae4323404bd29fe8c05a704de273 Aug 10 13:44:55.410744 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Name: tempest-AttachVolumeShelveTestJSON-854584124-project Aug 10 13:44:55.410744 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: method: > Aug 10 13:44:55.410744 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: exception: Instance 3aa512f7-4b23-46bf-aa72-a3f72f2e122f could not be found. Aug 10 13:44:55.410744 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: action_args: {'id': '3aa512f7-4b23-46bf-aa72-a3f72f2e122f'} Aug 10 13:44:55.411514 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:44:55.411514 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:55.411514 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:44:55.411514 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:44:55.411514 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:44:55.411514 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:44:55.411514 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:44:55.411514 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:44:55.411514 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:44:55.411514 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:44:55.411514 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aa512f7-4b23-46bf-aa72-a3f72f2e122f could not be found. Aug 10 13:44:55.411514 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:55.411514 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:44:55.411514 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:55.411514 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:55.411514 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:44:55.411514 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:44:55.411514 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:44:55.411514 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:44:55.411514 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:44:55.412786 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:44:55.412786 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 13:44:55.412786 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 13:44:55.412786 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 13:44:55.412786 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 13:44:55.412786 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:44:55.412786 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:44:55.412786 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:44:55.412786 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:44:55.412786 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aa512f7-4b23-46bf-aa72-a3f72f2e122f could not be found. Aug 10 13:44:55.412786 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:55.412786 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:44:55.412786 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:55.412786 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:55.412786 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:44:55.412786 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:44:55.412786 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:44:55.412786 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:44:55.412786 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aa512f7-4b23-46bf-aa72-a3f72f2e122f could not be found. Aug 10 13:44:55.412786 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:55.414119 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-74c92798-a1b3-4b25-87fb-4f36304ce369 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Returning 404 to user: Instance 3aa512f7-4b23-46bf-aa72-a3f72f2e122f could not be found. {{(pid=129523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:44:55.414119 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-74c92798-a1b3-4b25-87fb-4f36304ce369 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 404 len: 111 microversion: 2.20 time: 0.054622 Aug 10 13:44:55.414119 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 440/906] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Aug 10 13:44:55 2022] DELETE /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 13:44:55.420168 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-450e5052-7fbe-49fc-adbc-9c3e39a34da8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:55.420902 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-450e5052-7fbe-49fc-adbc-9c3e39a34da8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: 3aa512f7-4b23-46bf-aa72-a3f72f2e122f] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:55.427789 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-450e5052-7fbe-49fc-adbc-9c3e39a34da8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:55.428267 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-450e5052-7fbe-49fc-adbc-9c3e39a34da8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:55.428909 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-450e5052-7fbe-49fc-adbc-9c3e39a34da8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:55.429638 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-450e5052-7fbe-49fc-adbc-9c3e39a34da8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:55.430292 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-450e5052-7fbe-49fc-adbc-9c3e39a34da8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:55.430908 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-450e5052-7fbe-49fc-adbc-9c3e39a34da8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:55.444794 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.wsgi [None req-450e5052-7fbe-49fc-adbc-9c3e39a34da8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] HTTP exception thrown: Instance 3aa512f7-4b23-46bf-aa72-a3f72f2e122f could not be found. Aug 10 13:44:55.446957 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-450e5052-7fbe-49fc-adbc-9c3e39a34da8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Request method failure captured: Aug 10 13:44:55.446957 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: request: GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f HTTP/1.1 Aug 10 13:44:55.446957 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept: application/json Aug 10 13:44:55.446957 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept-Encoding: identity Aug 10 13:44:55.446957 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Connection: close Aug 10 13:44:55.446957 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Length: 0 Aug 10 13:44:55.446957 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Type: application/json Aug 10 13:44:55.446957 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Host: 10.222.0.52 Aug 10 13:44:55.446957 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Openstack-System-Scope: None Aug 10 13:44:55.446957 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: User-Agent: python-urllib3/1.26.11 Aug 10 13:44:55.446957 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Auth-Token: gAAAAABi87SjyxddKhUB7OUwPME21JMZGNdpbtCe9Qe7UZOBNnEqoMdGpeDVGCtahrN9iVRiXf3MBCGKxvt5ZDHVakZChOWNOR7x8LO7HCcoNIIwyXtoZlQ5CvJl1zAp5Hh5JeQRi8YGR91f8U8cbGHkEUbpcOG2SjLXruf_gDYc1HnXb6IZMDs Aug 10 13:44:55.446957 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Id: None Aug 10 13:44:55.446957 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Name: None Aug 10 13:44:55.446957 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Identity-Status: Confirmed Aug 10 13:44:55.446957 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Is-Admin-Project: True Aug 10 13:44:55.446957 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 13:44:55.446957 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Id: default Aug 10 13:44:55.446957 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Name: Default Aug 10 13:44:55.446957 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Id: b6cfb6539b69493ebef06cf7176b1935 Aug 10 13:44:55.446957 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-854584124 Aug 10 13:44:55.446957 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Role: member,reader Aug 10 13:44:55.446957 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Roles: member,reader Aug 10 13:44:55.448420 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b6cfb6539b69493ebef06cf7176b1935"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b6cfb6539b69493ebef06cf7176b1935"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b6cfb6539b69493ebef06cf7176b1935", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b6cfb6539b69493ebef06cf7176b1935"}]}] Aug 10 13:44:55.448420 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant: tempest-AttachVolumeShelveTestJSON-854584124 Aug 10 13:44:55.448420 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Id: b6cfb6539b69493ebef06cf7176b1935 Aug 10 13:44:55.448420 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-854584124 Aug 10 13:44:55.448420 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User: tempest-AttachVolumeShelveTestJSON-854584124-project Aug 10 13:44:55.448420 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Id: default Aug 10 13:44:55.448420 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Name: Default Aug 10 13:44:55.448420 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Id: 9cecae4323404bd29fe8c05a704de273 Aug 10 13:44:55.448420 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Name: tempest-AttachVolumeShelveTestJSON-854584124-project Aug 10 13:44:55.448420 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: method: > Aug 10 13:44:55.448420 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: exception: Instance 3aa512f7-4b23-46bf-aa72-a3f72f2e122f could not be found. Aug 10 13:44:55.448420 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: action_args: {'id': '3aa512f7-4b23-46bf-aa72-a3f72f2e122f'} Aug 10 13:44:55.449192 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:44:55.449192 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:55.449192 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:44:55.449192 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:44:55.449192 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:44:55.449192 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:44:55.449192 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:44:55.449192 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:44:55.449192 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:44:55.449192 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:44:55.449192 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aa512f7-4b23-46bf-aa72-a3f72f2e122f could not be found. Aug 10 13:44:55.449192 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:44:55.449192 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:44:55.449192 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:44:55.449192 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:55.449192 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:44:55.449192 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:44:55.449192 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:44:55.449192 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:44:55.449192 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:44:55.450840 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:44:55.450840 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:44:55.450840 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:44:55.450840 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:44:55.450840 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:44:55.450840 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:44:55.450840 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:44:55.450840 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aa512f7-4b23-46bf-aa72-a3f72f2e122f could not be found. Aug 10 13:44:55.450840 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:44:55.450840 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:44:55.450840 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:44:55.450840 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:55.450840 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:44:55.450840 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:44:55.450840 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:44:55.450840 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:44:55.450840 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aa512f7-4b23-46bf-aa72-a3f72f2e122f could not be found. Aug 10 13:44:55.450840 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:44:55.453514 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-450e5052-7fbe-49fc-adbc-9c3e39a34da8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Returning 404 to user: Instance 3aa512f7-4b23-46bf-aa72-a3f72f2e122f could not be found. {{(pid=129522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:44:55.454579 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-450e5052-7fbe-49fc-adbc-9c3e39a34da8 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f" status: 404 len: 111 microversion: 2.20 time: 0.039361 Aug 10 13:44:55.458743 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 467/907] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:44:55 2022] GET /compute/v2.1/servers/3aa512f7-4b23-46bf-aa72-a3f72f2e122f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 13:44:56.655767 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-d2ee4203-3b5d-44d9-a515-4d8fdb4234cc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:56.656467 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-d2ee4203-3b5d-44d9-a515-4d8fdb4234cc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:56.663499 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d2ee4203-3b5d-44d9-a515-4d8fdb4234cc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:56.663953 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d2ee4203-3b5d-44d9-a515-4d8fdb4234cc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:56.664412 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d2ee4203-3b5d-44d9-a515-4d8fdb4234cc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:56.664990 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d2ee4203-3b5d-44d9-a515-4d8fdb4234cc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:56.665472 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d2ee4203-3b5d-44d9-a515-4d8fdb4234cc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:56.665903 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d2ee4203-3b5d-44d9-a515-4d8fdb4234cc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:56.681391 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.wsgi [None req-d2ee4203-3b5d-44d9-a515-4d8fdb4234cc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] HTTP exception thrown: Instance cdba9a34-3f3e-4314-a377-e6dc259c27cb could not be found. Aug 10 13:44:56.682974 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-d2ee4203-3b5d-44d9-a515-4d8fdb4234cc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Request method failure captured: Aug 10 13:44:56.682974 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: request: DELETE /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb HTTP/1.1 Aug 10 13:44:56.682974 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept: application/json Aug 10 13:44:56.682974 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept-Encoding: identity Aug 10 13:44:56.682974 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Connection: close Aug 10 13:44:56.682974 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Length: 0 Aug 10 13:44:56.682974 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Type: application/json Aug 10 13:44:56.682974 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Host: 10.222.0.52 Aug 10 13:44:56.682974 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Openstack-System-Scope: None Aug 10 13:44:56.682974 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: User-Agent: python-urllib3/1.26.11 Aug 10 13:44:56.682974 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Auth-Token: gAAAAABi87SjyxddKhUB7OUwPME21JMZGNdpbtCe9Qe7UZOBNnEqoMdGpeDVGCtahrN9iVRiXf3MBCGKxvt5ZDHVakZChOWNOR7x8LO7HCcoNIIwyXtoZlQ5CvJl1zAp5Hh5JeQRi8YGR91f8U8cbGHkEUbpcOG2SjLXruf_gDYc1HnXb6IZMDs Aug 10 13:44:56.682974 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Id: None Aug 10 13:44:56.682974 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Name: None Aug 10 13:44:56.682974 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Identity-Status: Confirmed Aug 10 13:44:56.682974 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Is-Admin-Project: True Aug 10 13:44:56.682974 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 13:44:56.682974 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Id: default Aug 10 13:44:56.682974 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Name: Default Aug 10 13:44:56.682974 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Id: b6cfb6539b69493ebef06cf7176b1935 Aug 10 13:44:56.682974 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-854584124 Aug 10 13:44:56.682974 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Role: member,reader Aug 10 13:44:56.682974 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Roles: member,reader Aug 10 13:44:56.685732 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b6cfb6539b69493ebef06cf7176b1935"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b6cfb6539b69493ebef06cf7176b1935"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b6cfb6539b69493ebef06cf7176b1935", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b6cfb6539b69493ebef06cf7176b1935"}]}] Aug 10 13:44:56.685732 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant: tempest-AttachVolumeShelveTestJSON-854584124 Aug 10 13:44:56.685732 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Id: b6cfb6539b69493ebef06cf7176b1935 Aug 10 13:44:56.685732 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-854584124 Aug 10 13:44:56.685732 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User: tempest-AttachVolumeShelveTestJSON-854584124-project Aug 10 13:44:56.685732 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Id: default Aug 10 13:44:56.685732 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Name: Default Aug 10 13:44:56.685732 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Id: 9cecae4323404bd29fe8c05a704de273 Aug 10 13:44:56.685732 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Name: tempest-AttachVolumeShelveTestJSON-854584124-project Aug 10 13:44:56.685732 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: method: > Aug 10 13:44:56.685732 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: exception: Instance cdba9a34-3f3e-4314-a377-e6dc259c27cb could not be found. Aug 10 13:44:56.685732 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: action_args: {'id': 'cdba9a34-3f3e-4314-a377-e6dc259c27cb'} Aug 10 13:44:56.686536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:44:56.686536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:56.686536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:44:56.686536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:44:56.686536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:44:56.686536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:44:56.686536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:44:56.686536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:44:56.686536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:44:56.686536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:44:56.686536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdba9a34-3f3e-4314-a377-e6dc259c27cb could not be found. Aug 10 13:44:56.686536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:56.686536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:44:56.686536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:56.686536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:56.686536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:44:56.686536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:44:56.686536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:44:56.686536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:44:56.686536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:44:56.687783 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:44:56.687783 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 13:44:56.687783 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 13:44:56.687783 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 13:44:56.687783 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 13:44:56.687783 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:44:56.687783 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:44:56.687783 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:44:56.687783 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:44:56.687783 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdba9a34-3f3e-4314-a377-e6dc259c27cb could not be found. Aug 10 13:44:56.687783 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:56.687783 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:44:56.687783 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:56.687783 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:56.687783 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:44:56.687783 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:44:56.687783 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:44:56.687783 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:44:56.687783 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdba9a34-3f3e-4314-a377-e6dc259c27cb could not be found. Aug 10 13:44:56.687783 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:44:56.689885 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-d2ee4203-3b5d-44d9-a515-4d8fdb4234cc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Returning 404 to user: Instance cdba9a34-3f3e-4314-a377-e6dc259c27cb could not be found. {{(pid=129523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:44:56.689885 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-d2ee4203-3b5d-44d9-a515-4d8fdb4234cc tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 404 len: 111 microversion: 2.20 time: 0.033398 Aug 10 13:44:56.689885 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 441/908] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Aug 10 13:44:56 2022] DELETE /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 10 13:44:56.693406 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-352930d7-d424-4676-b35e-5ddc60b24de5 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:44:56.694020 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-352930d7-d424-4676-b35e-5ddc60b24de5 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] [instance: cdba9a34-3f3e-4314-a377-e6dc259c27cb] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:44:56.700345 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-352930d7-d424-4676-b35e-5ddc60b24de5 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:56.700828 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-352930d7-d424-4676-b35e-5ddc60b24de5 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:56.701306 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-352930d7-d424-4676-b35e-5ddc60b24de5 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:56.701983 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-352930d7-d424-4676-b35e-5ddc60b24de5 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:44:56.702443 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-352930d7-d424-4676-b35e-5ddc60b24de5 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:44:56.702849 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-352930d7-d424-4676-b35e-5ddc60b24de5 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:44:56.717931 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.wsgi [None req-352930d7-d424-4676-b35e-5ddc60b24de5 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] HTTP exception thrown: Instance cdba9a34-3f3e-4314-a377-e6dc259c27cb could not be found. Aug 10 13:44:56.728752 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-352930d7-d424-4676-b35e-5ddc60b24de5 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Request method failure captured: Aug 10 13:44:56.728752 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: request: GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb HTTP/1.1 Aug 10 13:44:56.728752 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept: application/json Aug 10 13:44:56.728752 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept-Encoding: identity Aug 10 13:44:56.728752 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Connection: close Aug 10 13:44:56.728752 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Length: 0 Aug 10 13:44:56.728752 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Type: application/json Aug 10 13:44:56.728752 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Host: 10.222.0.52 Aug 10 13:44:56.728752 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Openstack-System-Scope: None Aug 10 13:44:56.728752 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: User-Agent: python-urllib3/1.26.11 Aug 10 13:44:56.728752 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Auth-Token: gAAAAABi87SjyxddKhUB7OUwPME21JMZGNdpbtCe9Qe7UZOBNnEqoMdGpeDVGCtahrN9iVRiXf3MBCGKxvt5ZDHVakZChOWNOR7x8LO7HCcoNIIwyXtoZlQ5CvJl1zAp5Hh5JeQRi8YGR91f8U8cbGHkEUbpcOG2SjLXruf_gDYc1HnXb6IZMDs Aug 10 13:44:56.728752 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Id: None Aug 10 13:44:56.728752 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Name: None Aug 10 13:44:56.728752 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Identity-Status: Confirmed Aug 10 13:44:56.728752 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Is-Admin-Project: True Aug 10 13:44:56.728752 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 13:44:56.728752 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Id: default Aug 10 13:44:56.728752 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Name: Default Aug 10 13:44:56.728752 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Id: b6cfb6539b69493ebef06cf7176b1935 Aug 10 13:44:56.728752 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-854584124 Aug 10 13:44:56.728752 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Role: member,reader Aug 10 13:44:56.728752 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Roles: member,reader Aug 10 13:44:56.731004 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b6cfb6539b69493ebef06cf7176b1935"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b6cfb6539b69493ebef06cf7176b1935"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b6cfb6539b69493ebef06cf7176b1935", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b6cfb6539b69493ebef06cf7176b1935"}]}] Aug 10 13:44:56.731004 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant: tempest-AttachVolumeShelveTestJSON-854584124 Aug 10 13:44:56.731004 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Id: b6cfb6539b69493ebef06cf7176b1935 Aug 10 13:44:56.731004 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-854584124 Aug 10 13:44:56.731004 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User: tempest-AttachVolumeShelveTestJSON-854584124-project Aug 10 13:44:56.731004 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Id: default Aug 10 13:44:56.731004 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Name: Default Aug 10 13:44:56.731004 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Id: 9cecae4323404bd29fe8c05a704de273 Aug 10 13:44:56.731004 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Name: tempest-AttachVolumeShelveTestJSON-854584124-project Aug 10 13:44:56.731004 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: method: > Aug 10 13:44:56.731004 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: exception: Instance cdba9a34-3f3e-4314-a377-e6dc259c27cb could not be found. Aug 10 13:44:56.731004 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: action_args: {'id': 'cdba9a34-3f3e-4314-a377-e6dc259c27cb'} Aug 10 13:44:56.732091 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:44:56.732091 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:56.732091 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:44:56.732091 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:44:56.732091 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:44:56.732091 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:44:56.732091 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:44:56.732091 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:44:56.732091 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:44:56.732091 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:44:56.732091 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdba9a34-3f3e-4314-a377-e6dc259c27cb could not be found. Aug 10 13:44:56.732091 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:44:56.732091 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:44:56.732091 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:44:56.732091 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:56.732091 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:44:56.732091 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:44:56.732091 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:44:56.732091 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:44:56.732091 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:44:56.733689 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:44:56.733689 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:44:56.733689 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:44:56.733689 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:44:56.733689 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:44:56.733689 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:44:56.733689 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:44:56.733689 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdba9a34-3f3e-4314-a377-e6dc259c27cb could not be found. Aug 10 13:44:56.733689 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:44:56.733689 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:44:56.733689 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:44:56.733689 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:44:56.733689 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:44:56.733689 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:44:56.733689 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:44:56.733689 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:44:56.733689 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdba9a34-3f3e-4314-a377-e6dc259c27cb could not be found. Aug 10 13:44:56.733689 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:44:56.735082 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-352930d7-d424-4676-b35e-5ddc60b24de5 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] Returning 404 to user: Instance cdba9a34-3f3e-4314-a377-e6dc259c27cb could not be found. {{(pid=129522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:44:56.735082 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-352930d7-d424-4676-b35e-5ddc60b24de5 tempest-AttachVolumeShelveTestJSON-854584124 tempest-AttachVolumeShelveTestJSON-854584124-project] 10.222.0.52 "GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb" status: 404 len: 111 microversion: 2.20 time: 0.032097 Aug 10 13:44:56.735082 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 468/909] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 10 13:44:56 2022] GET /compute/v2.1/servers/cdba9a34-3f3e-4314-a377-e6dc259c27cb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 10 13:45:26.401909 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-568ba143-f5e0-4d62-b6ae-d08df485a282 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1404150786", "imageRef": "096d81df-12b1-4175-b914-babe0fa931c6", "flavorRef": "452", "networks": [{"uuid": "f4d88cab-1e7e-48aa-8772-126e0c18f27b"}]}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:45:26.410277 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_api:SELECT=7 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:45:26.410902 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell1:SELECT=23 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:45:26.457095 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.network.neutron [None req-568ba143-f5e0-4d62-b6ae-d08df485a282 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] validate_networks() for [('f4d88cab-1e7e-48aa-8772-126e0c18f27b', None, None, None, None, None)] {{(pid=129523) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:45:26.812579 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-568ba143-f5e0-4d62-b6ae-d08df485a282 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Flavor limits 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:45:26.813003 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-568ba143-f5e0-4d62-b6ae-d08df485a282 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Image limits 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:45:26.813530 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-568ba143-f5e0-4d62-b6ae-d08df485a282 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Flavor pref 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:45:26.813943 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-568ba143-f5e0-4d62-b6ae-d08df485a282 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Image pref 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:45:26.814354 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-568ba143-f5e0-4d62-b6ae-d08df485a282 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:45:26.825143 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-568ba143-f5e0-4d62-b6ae-d08df485a282 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:45:26.825756 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-568ba143-f5e0-4d62-b6ae-d08df485a282 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:45:26.826280 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-568ba143-f5e0-4d62-b6ae-d08df485a282 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:45:26.827088 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-568ba143-f5e0-4d62-b6ae-d08df485a282 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:45:26.827623 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-568ba143-f5e0-4d62-b6ae-d08df485a282 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:45:26.828104 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-568ba143-f5e0-4d62-b6ae-d08df485a282 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:45:26.848847 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-568ba143-f5e0-4d62-b6ae-d08df485a282 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Getting quotas for project bf531c40d3f74fa6aaf3d26794dca09c. Resources: {'cores', 'ram', 'instances'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:45:26.853026 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-568ba143-f5e0-4d62-b6ae-d08df485a282 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Getting quotas for user 0968c56b8be242918903711961b6d5c0 and project bf531c40d3f74fa6aaf3d26794dca09c. Resources: {'cores', 'ram', 'instances'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:45:26.866228 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-568ba143-f5e0-4d62-b6ae-d08df485a282 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Going to run 1 instances... {{(pid=129523) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:45:26.868544 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-568ba143-f5e0-4d62-b6ae-d08df485a282 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='096d81df-12b1-4175-b914-babe0fa931c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:45:26.916666 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-568ba143-f5e0-4d62-b6ae-d08df485a282 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519049 Aug 10 13:45:26.917331 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 442/910] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 10 13:45:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 13:45:26.928759 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-32c81360-9a68-43a8-80a4-0ac0b1ccc4f4 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:45:26.929425 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-32c81360-9a68-43a8-80a4-0ac0b1ccc4f4 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:45:26.931667 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:45:26.933162 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell1:SELECT=11 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:45:26.994360 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-32c81360-9a68-43a8-80a4-0ac0b1ccc4f4 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:45:27.001741 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-32c81360-9a68-43a8-80a4-0ac0b1ccc4f4 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51" status: 200 len: 1219 microversion: 2.1 time: 0.077000 Aug 10 13:45:27.002238 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 469/911] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:45:26 2022] GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:45:28.023921 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-48a6e682-a946-454a-b59b-a8a9329b347b tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:45:28.024920 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-48a6e682-a946-454a-b59b-a8a9329b347b tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:45:28.032399 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-48a6e682-a946-454a-b59b-a8a9329b347b tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:45:28.033003 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-48a6e682-a946-454a-b59b-a8a9329b347b tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:45:28.034391 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-48a6e682-a946-454a-b59b-a8a9329b347b tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:45:28.035228 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-48a6e682-a946-454a-b59b-a8a9329b347b tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:45:28.035832 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-48a6e682-a946-454a-b59b-a8a9329b347b tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:45:28.036361 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-48a6e682-a946-454a-b59b-a8a9329b347b tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:45:28.240544 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-48a6e682-a946-454a-b59b-a8a9329b347b tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:45:28.254471 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-48a6e682-a946-454a-b59b-a8a9329b347b tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51" status: 200 len: 1277 microversion: 2.1 time: 0.235356 Aug 10 13:45:28.255384 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 443/912] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:45:28 2022] GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51 => generated 1277 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:45:29.290248 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-dafaaa1d-a010-4078-b22f-271485139f44 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:45:29.292408 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-dafaaa1d-a010-4078-b22f-271485139f44 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:45:29.305982 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-dafaaa1d-a010-4078-b22f-271485139f44 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:45:29.306479 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-dafaaa1d-a010-4078-b22f-271485139f44 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:45:29.306913 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-dafaaa1d-a010-4078-b22f-271485139f44 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:45:29.307662 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-dafaaa1d-a010-4078-b22f-271485139f44 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:45:29.312502 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-dafaaa1d-a010-4078-b22f-271485139f44 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:45:29.312983 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-dafaaa1d-a010-4078-b22f-271485139f44 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:45:29.495781 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-dafaaa1d-a010-4078-b22f-271485139f44 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:45:29.504485 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-dafaaa1d-a010-4078-b22f-271485139f44 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51" status: 200 len: 1319 microversion: 2.1 time: 0.224669 Aug 10 13:45:29.505044 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 470/913] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:45:29 2022] GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:45:29.728694 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-4ef74f7a-4ef8-4b2b-8f07-66f7b0b358ea req-10dfec9e-3e9b-4ca9-8cfc-d15a803e63a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51", "tag": "ca3e678d-e424-476f-8d3f-420e80eab574"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:45:29.771789 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-4ef74f7a-4ef8-4b2b-8f07-66f7b0b358ea req-10dfec9e-3e9b-4ca9-8cfc-d15a803e63a8 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:45:29.773406 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-4ef74f7a-4ef8-4b2b-8f07-66f7b0b358ea req-10dfec9e-3e9b-4ca9-8cfc-d15a803e63a8 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:45:29.773853 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-4ef74f7a-4ef8-4b2b-8f07-66f7b0b358ea req-10dfec9e-3e9b-4ca9-8cfc-d15a803e63a8 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:45:29.786593 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-4ef74f7a-4ef8-4b2b-8f07-66f7b0b358ea req-10dfec9e-3e9b-4ca9-8cfc-d15a803e63a8 service nova] Creating event network-changed:ca3e678d-e424-476f-8d3f-420e80eab574 for instance 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51 on hv-cinder-85200 Aug 10 13:45:29.793592 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-4ef74f7a-4ef8-4b2b-8f07-66f7b0b358ea req-10dfec9e-3e9b-4ca9-8cfc-d15a803e63a8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068445 Aug 10 13:45:29.795537 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 444/914] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:45:30.527375 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-b42288fc-51ef-437e-a85e-1ba338ef9b39 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:45:30.528019 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-b42288fc-51ef-437e-a85e-1ba338ef9b39 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:45:30.536161 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b42288fc-51ef-437e-a85e-1ba338ef9b39 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:45:30.536655 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b42288fc-51ef-437e-a85e-1ba338ef9b39 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:45:30.537091 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b42288fc-51ef-437e-a85e-1ba338ef9b39 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:45:30.537874 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b42288fc-51ef-437e-a85e-1ba338ef9b39 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:45:30.538578 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b42288fc-51ef-437e-a85e-1ba338ef9b39 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:45:30.538946 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b42288fc-51ef-437e-a85e-1ba338ef9b39 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:45:30.685824 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-b42288fc-51ef-437e-a85e-1ba338ef9b39 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:45:30.696012 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-b42288fc-51ef-437e-a85e-1ba338ef9b39 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51" status: 200 len: 1319 microversion: 2.1 time: 0.173892 Aug 10 13:45:30.696721 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 471/915] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:45:30 2022] GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:45:31.716468 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-e24e5948-e467-484d-bf01-29d65c0b3018 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:45:31.717167 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-e24e5948-e467-484d-bf01-29d65c0b3018 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:45:31.724240 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e24e5948-e467-484d-bf01-29d65c0b3018 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:45:31.724659 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e24e5948-e467-484d-bf01-29d65c0b3018 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:45:31.725094 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e24e5948-e467-484d-bf01-29d65c0b3018 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:45:31.725819 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e24e5948-e467-484d-bf01-29d65c0b3018 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:45:31.726273 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e24e5948-e467-484d-bf01-29d65c0b3018 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:45:31.726698 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e24e5948-e467-484d-bf01-29d65c0b3018 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:45:31.859826 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-e24e5948-e467-484d-bf01-29d65c0b3018 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:45:31.867889 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-e24e5948-e467-484d-bf01-29d65c0b3018 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51" status: 200 len: 1319 microversion: 2.1 time: 0.155639 Aug 10 13:45:31.868570 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 445/916] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:45:31 2022] GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:45:32.890426 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-dee58bc4-cde8-4cee-b7d3-2a631e6ab2cd tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:45:32.891221 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-dee58bc4-cde8-4cee-b7d3-2a631e6ab2cd tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:45:32.897558 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-dee58bc4-cde8-4cee-b7d3-2a631e6ab2cd tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:45:32.898382 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-dee58bc4-cde8-4cee-b7d3-2a631e6ab2cd tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:45:32.898874 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-dee58bc4-cde8-4cee-b7d3-2a631e6ab2cd tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:45:32.899610 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-dee58bc4-cde8-4cee-b7d3-2a631e6ab2cd tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:45:32.900096 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-dee58bc4-cde8-4cee-b7d3-2a631e6ab2cd tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:45:32.900770 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-dee58bc4-cde8-4cee-b7d3-2a631e6ab2cd tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:45:33.055417 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-dee58bc4-cde8-4cee-b7d3-2a631e6ab2cd tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:45:33.064406 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-dee58bc4-cde8-4cee-b7d3-2a631e6ab2cd tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51" status: 200 len: 1319 microversion: 2.1 time: 0.178397 Aug 10 13:45:33.065081 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 472/917] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:45:32 2022] GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:45:33.410162 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-ca0b742a-ea6f-4dbb-aa8d-aa8fc381679f req-78a1e2b5-3aa4-42d8-9f88-13f17512ebc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51", "name": "network-vif-plugged", "status": "completed", "tag": "ca3e678d-e424-476f-8d3f-420e80eab574"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:45:33.421588 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-ca0b742a-ea6f-4dbb-aa8d-aa8fc381679f req-78a1e2b5-3aa4-42d8-9f88-13f17512ebc7 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:45:33.421927 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-ca0b742a-ea6f-4dbb-aa8d-aa8fc381679f req-78a1e2b5-3aa4-42d8-9f88-13f17512ebc7 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:45:33.422366 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-ca0b742a-ea6f-4dbb-aa8d-aa8fc381679f req-78a1e2b5-3aa4-42d8-9f88-13f17512ebc7 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:45:33.437331 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-ca0b742a-ea6f-4dbb-aa8d-aa8fc381679f req-78a1e2b5-3aa4-42d8-9f88-13f17512ebc7 service nova] Creating event network-vif-plugged:ca3e678d-e424-476f-8d3f-420e80eab574 for instance 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51 on hv-cinder-85200 Aug 10 13:45:33.440795 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-ca0b742a-ea6f-4dbb-aa8d-aa8fc381679f req-78a1e2b5-3aa4-42d8-9f88-13f17512ebc7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034237 Aug 10 13:45:33.441650 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 446/918] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:45:34.088218 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-4eb8af24-ddff-4d3a-baba-b72e12cb713f tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:45:34.089446 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-4eb8af24-ddff-4d3a-baba-b72e12cb713f tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:45:34.096067 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4eb8af24-ddff-4d3a-baba-b72e12cb713f tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:45:34.096549 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4eb8af24-ddff-4d3a-baba-b72e12cb713f tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:45:34.096983 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4eb8af24-ddff-4d3a-baba-b72e12cb713f tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:45:34.097744 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4eb8af24-ddff-4d3a-baba-b72e12cb713f tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:45:34.098202 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4eb8af24-ddff-4d3a-baba-b72e12cb713f tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:45:34.098655 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4eb8af24-ddff-4d3a-baba-b72e12cb713f tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:45:34.241798 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-4eb8af24-ddff-4d3a-baba-b72e12cb713f tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:45:34.250612 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-4eb8af24-ddff-4d3a-baba-b72e12cb713f tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51" status: 200 len: 1319 microversion: 2.1 time: 0.166270 Aug 10 13:45:34.251144 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 473/919] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:45:34 2022] GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:45:35.271433 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-6ef522eb-b1e0-4eb6-b2e6-2ce22d24907e tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:45:35.272174 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-6ef522eb-b1e0-4eb6-b2e6-2ce22d24907e tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:45:35.279517 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6ef522eb-b1e0-4eb6-b2e6-2ce22d24907e tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:45:35.280006 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6ef522eb-b1e0-4eb6-b2e6-2ce22d24907e tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:45:35.280446 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6ef522eb-b1e0-4eb6-b2e6-2ce22d24907e tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:45:35.281141 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6ef522eb-b1e0-4eb6-b2e6-2ce22d24907e tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:45:35.281619 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6ef522eb-b1e0-4eb6-b2e6-2ce22d24907e tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:45:35.282044 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6ef522eb-b1e0-4eb6-b2e6-2ce22d24907e tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:45:35.420153 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-6ef522eb-b1e0-4eb6-b2e6-2ce22d24907e tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:45:35.427651 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-6ef522eb-b1e0-4eb6-b2e6-2ce22d24907e tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51" status: 200 len: 1319 microversion: 2.1 time: 0.160431 Aug 10 13:45:35.428211 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 447/920] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:45:35 2022] GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:45:36.448527 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-3d2678a5-5219-4ed9-b457-1d52e71f8d8f tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:45:36.449121 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-3d2678a5-5219-4ed9-b457-1d52e71f8d8f tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:45:36.456216 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3d2678a5-5219-4ed9-b457-1d52e71f8d8f tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:45:36.456703 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3d2678a5-5219-4ed9-b457-1d52e71f8d8f tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:45:36.457145 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3d2678a5-5219-4ed9-b457-1d52e71f8d8f tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:45:36.457984 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3d2678a5-5219-4ed9-b457-1d52e71f8d8f tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:45:36.458514 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3d2678a5-5219-4ed9-b457-1d52e71f8d8f tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:45:36.458981 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3d2678a5-5219-4ed9-b457-1d52e71f8d8f tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:45:36.593007 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-3d2678a5-5219-4ed9-b457-1d52e71f8d8f tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:45:36.600569 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-3d2678a5-5219-4ed9-b457-1d52e71f8d8f tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51" status: 200 len: 1319 microversion: 2.1 time: 0.156408 Aug 10 13:45:36.601126 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 474/921] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:45:36 2022] GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:45:37.622300 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-4b6a3c57-f2c6-46a8-ac0d-2f6b1303f32f tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:45:37.622919 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-4b6a3c57-f2c6-46a8-ac0d-2f6b1303f32f tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:45:37.624913 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell0:SELECT=2 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:45:37.625589 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell0:SELECT=6 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:45:37.631314 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4b6a3c57-f2c6-46a8-ac0d-2f6b1303f32f tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:45:37.631799 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4b6a3c57-f2c6-46a8-ac0d-2f6b1303f32f tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:45:37.632237 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4b6a3c57-f2c6-46a8-ac0d-2f6b1303f32f tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:45:37.632932 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4b6a3c57-f2c6-46a8-ac0d-2f6b1303f32f tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:45:37.633434 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4b6a3c57-f2c6-46a8-ac0d-2f6b1303f32f tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:45:37.633862 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4b6a3c57-f2c6-46a8-ac0d-2f6b1303f32f tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:45:37.767128 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-4b6a3c57-f2c6-46a8-ac0d-2f6b1303f32f tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:45:37.774594 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-4b6a3c57-f2c6-46a8-ac0d-2f6b1303f32f tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51" status: 200 len: 1319 microversion: 2.1 time: 0.156949 Aug 10 13:45:37.775157 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 448/922] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:45:37 2022] GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:45:38.795049 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-2d1f5526-a55d-44d4-8f3c-b5b903bb6b29 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:45:38.795601 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-2d1f5526-a55d-44d4-8f3c-b5b903bb6b29 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:45:38.797487 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell0:SELECT=2 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:45:38.804375 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2d1f5526-a55d-44d4-8f3c-b5b903bb6b29 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:45:38.805079 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2d1f5526-a55d-44d4-8f3c-b5b903bb6b29 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:45:38.806026 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2d1f5526-a55d-44d4-8f3c-b5b903bb6b29 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:45:38.806930 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2d1f5526-a55d-44d4-8f3c-b5b903bb6b29 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:45:38.807920 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2d1f5526-a55d-44d4-8f3c-b5b903bb6b29 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:45:38.808348 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2d1f5526-a55d-44d4-8f3c-b5b903bb6b29 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:45:38.951875 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-2d1f5526-a55d-44d4-8f3c-b5b903bb6b29 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:45:38.959541 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-2d1f5526-a55d-44d4-8f3c-b5b903bb6b29 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51" status: 200 len: 1508 microversion: 2.1 time: 0.168394 Aug 10 13:45:38.960150 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 475/923] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:45:38 2022] GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51 => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:46:08.917054 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-cabbd82d-768f-4a11-8e98-fa31e58e5a4e tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f82485e7-beba-4e01-abe6-146c975f5516", "device": "/dev/sdb"}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:46:08.920062 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-cabbd82d-768f-4a11-8e98-fa31e58e5a4e tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:46:08.923271 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:46:08.924015 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell1:SELECT=30 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:46:08.928149 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cabbd82d-768f-4a11-8e98-fa31e58e5a4e tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:08.928639 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cabbd82d-768f-4a11-8e98-fa31e58e5a4e tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:08.929074 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cabbd82d-768f-4a11-8e98-fa31e58e5a4e tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:08.929795 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cabbd82d-768f-4a11-8e98-fa31e58e5a4e tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:08.930336 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cabbd82d-768f-4a11-8e98-fa31e58e5a4e tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:08.930765 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cabbd82d-768f-4a11-8e98-fa31e58e5a4e tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:09.201009 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-cabbd82d-768f-4a11-8e98-fa31e58e5a4e tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "POST /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287679 Aug 10 13:46:09.201647 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 449/924] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 10 13:46:08 2022] POST /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:46:13.078368 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:46:13.079153 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Wed Aug 10 13:46:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 13:46:37.223567 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-fcb28108-52b8-4b9b-ae4e-50c61851a964 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:46:37.224287 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-fcb28108-52b8-4b9b-ae4e-50c61851a964 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:46:37.226143 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_api:SELECT=16 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:46:37.226999 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell1:SELECT=36 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:46:37.233737 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fcb28108-52b8-4b9b-ae4e-50c61851a964 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:37.234234 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fcb28108-52b8-4b9b-ae4e-50c61851a964 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:37.234674 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fcb28108-52b8-4b9b-ae4e-50c61851a964 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:37.235415 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fcb28108-52b8-4b9b-ae4e-50c61851a964 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:37.235869 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fcb28108-52b8-4b9b-ae4e-50c61851a964 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:37.236297 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fcb28108-52b8-4b9b-ae4e-50c61851a964 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:37.332589 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.objects.instance [None req-fcb28108-52b8-4b9b-ae4e-50c61851a964 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lazy-loading 'services' on Instance uuid 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51 {{(pid=129522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:46:37.444932 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-fcb28108-52b8-4b9b-ae4e-50c61851a964 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51/os-volume_attachments/f82485e7-beba-4e01-abe6-146c975f5516" status: 202 len: 0 microversion: 2.1 time: 0.225382 Aug 10 13:46:37.450268 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 476/925] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Aug 10 13:46:37 2022] DELETE /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51/os-volume_attachments/f82485e7-beba-4e01-abe6-146c975f5516 => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:46:38.204117 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_api:SELECT=2 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:46:38.205036 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:46:38.213852 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-338d65c7-1532-4113-b7b6-ece6a11c7ba6 req-ccec3575-71b2-4230-a93b-55e2950f83a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52cd9b3e-aa05-41f0-b17a-d78f06e5d176", "tag": "3874b623-0ac2-47e5-88e0-78f207e051a4"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:46:38.218455 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-72872060-0bdb-44d9-b12d-9e79e4c5565c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:46:38.220906 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-72872060-0bdb-44d9-b12d-9e79e4c5565c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:46:38.246616 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-338d65c7-1532-4113-b7b6-ece6a11c7ba6 req-ccec3575-71b2-4230-a93b-55e2950f83a6 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:38.247691 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-338d65c7-1532-4113-b7b6-ece6a11c7ba6 req-ccec3575-71b2-4230-a93b-55e2950f83a6 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:38.248326 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-338d65c7-1532-4113-b7b6-ece6a11c7ba6 req-ccec3575-71b2-4230-a93b-55e2950f83a6 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:38.257897 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-72872060-0bdb-44d9-b12d-9e79e4c5565c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:38.258566 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-72872060-0bdb-44d9-b12d-9e79e4c5565c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:38.259107 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-72872060-0bdb-44d9-b12d-9e79e4c5565c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:38.259957 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-72872060-0bdb-44d9-b12d-9e79e4c5565c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:38.260484 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-72872060-0bdb-44d9-b12d-9e79e4c5565c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:38.261158 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-72872060-0bdb-44d9-b12d-9e79e4c5565c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:38.291930 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-338d65c7-1532-4113-b7b6-ece6a11c7ba6 req-ccec3575-71b2-4230-a93b-55e2950f83a6 service nova] Creating event network-changed:3874b623-0ac2-47e5-88e0-78f207e051a4 for instance 52cd9b3e-aa05-41f0-b17a-d78f06e5d176 on hv-cinder-85200 Aug 10 13:46:38.293506 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-72872060-0bdb-44d9-b12d-9e79e4c5565c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Going to try to terminate instance {{(pid=129523) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:46:38.297661 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-338d65c7-1532-4113-b7b6-ece6a11c7ba6 req-ccec3575-71b2-4230-a93b-55e2950f83a6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088371 Aug 10 13:46:38.298527 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 477/926] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:46:38.452071 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-72872060-0bdb-44d9-b12d-9e79e4c5565c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "DELETE /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 204 len: 0 microversion: 2.1 time: 0.249344 Aug 10 13:46:38.454055 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 450/927] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 10 13:46:38 2022] DELETE /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:46:38.466126 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-f0cf589a-3388-40f5-addb-f16a50a0a07d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:46:38.467016 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-f0cf589a-3388-40f5-addb-f16a50a0a07d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:46:38.474166 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f0cf589a-3388-40f5-addb-f16a50a0a07d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:38.474837 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f0cf589a-3388-40f5-addb-f16a50a0a07d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:38.475378 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f0cf589a-3388-40f5-addb-f16a50a0a07d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:38.476226 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f0cf589a-3388-40f5-addb-f16a50a0a07d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:38.476779 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f0cf589a-3388-40f5-addb-f16a50a0a07d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:38.477546 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f0cf589a-3388-40f5-addb-f16a50a0a07d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:38.644660 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-80d19cae-6cbc-475a-b1ba-b72937de5b15 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:46:38.645269 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-80d19cae-6cbc-475a-b1ba-b72937de5b15 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:46:38.653041 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-80d19cae-6cbc-475a-b1ba-b72937de5b15 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:38.653675 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-80d19cae-6cbc-475a-b1ba-b72937de5b15 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:38.654163 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-80d19cae-6cbc-475a-b1ba-b72937de5b15 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:38.654970 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-80d19cae-6cbc-475a-b1ba-b72937de5b15 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:38.655560 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-80d19cae-6cbc-475a-b1ba-b72937de5b15 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:38.655992 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-80d19cae-6cbc-475a-b1ba-b72937de5b15 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:38.656204 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-f0cf589a-3388-40f5-addb-f16a50a0a07d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:46:38.664999 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-f0cf589a-3388-40f5-addb-f16a50a0a07d tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1578 microversion: 2.1 time: 0.206409 Aug 10 13:46:38.673469 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 478/928] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:46:38 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1578 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:46:38.689536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-80d19cae-6cbc-475a-b1ba-b72937de5b15 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51] Going to try to terminate instance {{(pid=129523) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:46:38.786541 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-80d19cae-6cbc-475a-b1ba-b72937de5b15 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51" status: 204 len: 0 microversion: 2.1 time: 0.146873 Aug 10 13:46:38.787606 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 451/929] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 10 13:46:38 2022] DELETE /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 13:46:38.797896 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-c4f86a0b-8c9e-42d8-8d53-cfa52bf1a9d0 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:46:38.798772 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-c4f86a0b-8c9e-42d8-8d53-cfa52bf1a9d0 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:46:38.804576 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c4f86a0b-8c9e-42d8-8d53-cfa52bf1a9d0 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:38.805056 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c4f86a0b-8c9e-42d8-8d53-cfa52bf1a9d0 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:38.806073 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c4f86a0b-8c9e-42d8-8d53-cfa52bf1a9d0 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:38.806764 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c4f86a0b-8c9e-42d8-8d53-cfa52bf1a9d0 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:38.807212 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c4f86a0b-8c9e-42d8-8d53-cfa52bf1a9d0 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:38.807634 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c4f86a0b-8c9e-42d8-8d53-cfa52bf1a9d0 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:38.953605 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-c4f86a0b-8c9e-42d8-8d53-cfa52bf1a9d0 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:46:38.962489 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-c4f86a0b-8c9e-42d8-8d53-cfa52bf1a9d0 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51" status: 200 len: 1514 microversion: 2.1 time: 0.168691 Aug 10 13:46:38.963623 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 479/930] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:46:38 2022] GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:46:39.691673 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-2ef20922-17c8-4ec7-9fbb-4c3e9b486771 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:46:39.692551 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-2ef20922-17c8-4ec7-9fbb-4c3e9b486771 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:46:39.705927 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2ef20922-17c8-4ec7-9fbb-4c3e9b486771 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:39.706775 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2ef20922-17c8-4ec7-9fbb-4c3e9b486771 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:39.707610 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2ef20922-17c8-4ec7-9fbb-4c3e9b486771 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:39.709352 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2ef20922-17c8-4ec7-9fbb-4c3e9b486771 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:39.710039 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2ef20922-17c8-4ec7-9fbb-4c3e9b486771 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:39.710653 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2ef20922-17c8-4ec7-9fbb-4c3e9b486771 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:39.851249 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-2ef20922-17c8-4ec7-9fbb-4c3e9b486771 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:46:39.858982 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-2ef20922-17c8-4ec7-9fbb-4c3e9b486771 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1578 microversion: 2.1 time: 0.171796 Aug 10 13:46:39.859561 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 452/931] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:46:39 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1578 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:46:39.986870 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-4da24f36-aab0-47eb-a4b3-4057bf0c4168 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:46:39.988004 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-4da24f36-aab0-47eb-a4b3-4057bf0c4168 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:46:40.002998 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4da24f36-aab0-47eb-a4b3-4057bf0c4168 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:40.003746 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4da24f36-aab0-47eb-a4b3-4057bf0c4168 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:40.003746 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4da24f36-aab0-47eb-a4b3-4057bf0c4168 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:40.003746 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4da24f36-aab0-47eb-a4b3-4057bf0c4168 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:40.007366 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4da24f36-aab0-47eb-a4b3-4057bf0c4168 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:40.008121 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4da24f36-aab0-47eb-a4b3-4057bf0c4168 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:40.183004 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-4da24f36-aab0-47eb-a4b3-4057bf0c4168 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:46:40.191904 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-4da24f36-aab0-47eb-a4b3-4057bf0c4168 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51" status: 200 len: 1514 microversion: 2.1 time: 0.210329 Aug 10 13:46:40.192499 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 480/932] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:46:39 2022] GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51 => generated 1514 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:46:40.881204 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-88bfe772-6e10-4401-8c93-2a2a11a7aa53 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:46:40.881851 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-88bfe772-6e10-4401-8c93-2a2a11a7aa53 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:46:40.888719 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-88bfe772-6e10-4401-8c93-2a2a11a7aa53 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:40.889204 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-88bfe772-6e10-4401-8c93-2a2a11a7aa53 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:40.889678 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-88bfe772-6e10-4401-8c93-2a2a11a7aa53 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:40.890368 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-88bfe772-6e10-4401-8c93-2a2a11a7aa53 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:40.890825 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-88bfe772-6e10-4401-8c93-2a2a11a7aa53 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:40.891355 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-88bfe772-6e10-4401-8c93-2a2a11a7aa53 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:41.023755 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-88bfe772-6e10-4401-8c93-2a2a11a7aa53 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:46:41.031765 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-88bfe772-6e10-4401-8c93-2a2a11a7aa53 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1578 microversion: 2.1 time: 0.154457 Aug 10 13:46:41.032349 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 453/933] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:46:40 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:46:41.213934 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-d5b0f61d-5748-4ac8-8994-bde04d67aa48 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:46:41.214546 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-d5b0f61d-5748-4ac8-8994-bde04d67aa48 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:46:41.220892 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d5b0f61d-5748-4ac8-8994-bde04d67aa48 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:41.221431 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d5b0f61d-5748-4ac8-8994-bde04d67aa48 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:41.222482 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d5b0f61d-5748-4ac8-8994-bde04d67aa48 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:41.223193 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d5b0f61d-5748-4ac8-8994-bde04d67aa48 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:41.223646 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d5b0f61d-5748-4ac8-8994-bde04d67aa48 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:41.224065 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d5b0f61d-5748-4ac8-8994-bde04d67aa48 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:41.366522 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-d5b0f61d-5748-4ac8-8994-bde04d67aa48 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:46:41.374631 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-d5b0f61d-5748-4ac8-8994-bde04d67aa48 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51" status: 200 len: 1514 microversion: 2.1 time: 0.164511 Aug 10 13:46:41.375200 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 481/934] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:46:41 2022] GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:46:42.053824 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-826c81b6-4462-44b5-ad44-5600e93694e7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:46:42.054528 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-826c81b6-4462-44b5-ad44-5600e93694e7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:46:42.061905 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-826c81b6-4462-44b5-ad44-5600e93694e7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:42.062389 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-826c81b6-4462-44b5-ad44-5600e93694e7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:42.062819 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-826c81b6-4462-44b5-ad44-5600e93694e7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:42.063513 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-826c81b6-4462-44b5-ad44-5600e93694e7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:42.063965 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-826c81b6-4462-44b5-ad44-5600e93694e7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:42.064385 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-826c81b6-4462-44b5-ad44-5600e93694e7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:42.205651 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-826c81b6-4462-44b5-ad44-5600e93694e7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:46:42.214017 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-826c81b6-4462-44b5-ad44-5600e93694e7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1578 microversion: 2.1 time: 0.164710 Aug 10 13:46:42.214582 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 454/935] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:46:42 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:46:42.396661 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-69f92d26-731f-4b99-bab3-8ac0cc90da97 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:46:42.397297 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-69f92d26-731f-4b99-bab3-8ac0cc90da97 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:46:42.404358 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-69f92d26-731f-4b99-bab3-8ac0cc90da97 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:42.404839 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-69f92d26-731f-4b99-bab3-8ac0cc90da97 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:42.405294 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-69f92d26-731f-4b99-bab3-8ac0cc90da97 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:42.405990 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-69f92d26-731f-4b99-bab3-8ac0cc90da97 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:42.406442 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-69f92d26-731f-4b99-bab3-8ac0cc90da97 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:42.406904 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-69f92d26-731f-4b99-bab3-8ac0cc90da97 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:42.537406 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-69f92d26-731f-4b99-bab3-8ac0cc90da97 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:46:42.544490 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-69f92d26-731f-4b99-bab3-8ac0cc90da97 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51" status: 200 len: 1514 microversion: 2.1 time: 0.151713 Aug 10 13:46:42.545292 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 482/936] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:46:42 2022] GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:46:43.234610 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-e718996e-696d-435a-b546-29f4741e2de3 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:46:43.235329 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-e718996e-696d-435a-b546-29f4741e2de3 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:46:43.241943 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e718996e-696d-435a-b546-29f4741e2de3 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:43.242486 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e718996e-696d-435a-b546-29f4741e2de3 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:43.242910 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e718996e-696d-435a-b546-29f4741e2de3 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:43.243602 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e718996e-696d-435a-b546-29f4741e2de3 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:43.244054 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e718996e-696d-435a-b546-29f4741e2de3 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:43.244479 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e718996e-696d-435a-b546-29f4741e2de3 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:43.375960 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-e718996e-696d-435a-b546-29f4741e2de3 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:46:43.384833 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-e718996e-696d-435a-b546-29f4741e2de3 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1578 microversion: 2.1 time: 0.153975 Aug 10 13:46:43.385473 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 455/937] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:46:43 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:46:43.566214 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-42a23ef3-e441-4d86-8784-57162c1f4491 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:46:43.566852 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-42a23ef3-e441-4d86-8784-57162c1f4491 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:46:43.573991 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-42a23ef3-e441-4d86-8784-57162c1f4491 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:43.574433 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-42a23ef3-e441-4d86-8784-57162c1f4491 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:43.574865 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-42a23ef3-e441-4d86-8784-57162c1f4491 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:43.575569 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-42a23ef3-e441-4d86-8784-57162c1f4491 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:43.576014 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-42a23ef3-e441-4d86-8784-57162c1f4491 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:43.576431 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-42a23ef3-e441-4d86-8784-57162c1f4491 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:43.740490 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-42a23ef3-e441-4d86-8784-57162c1f4491 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:46:43.748320 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-42a23ef3-e441-4d86-8784-57162c1f4491 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51" status: 200 len: 1514 microversion: 2.1 time: 0.186004 Aug 10 13:46:43.762144 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 483/938] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:46:43 2022] GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51 => generated 1514 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:46:43.770482 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-0ca3080f-bfbf-4837-a0a5-8234306fa49e req-b973e1d1-c0b6-4231-afb0-44e9400bffec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52cd9b3e-aa05-41f0-b17a-d78f06e5d176", "name": "network-vif-unplugged", "status": "completed", "tag": "3874b623-0ac2-47e5-88e0-78f207e051a4"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:46:43.780182 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-0ca3080f-bfbf-4837-a0a5-8234306fa49e req-b973e1d1-c0b6-4231-afb0-44e9400bffec service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:43.780658 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-0ca3080f-bfbf-4837-a0a5-8234306fa49e req-b973e1d1-c0b6-4231-afb0-44e9400bffec service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:43.781420 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-0ca3080f-bfbf-4837-a0a5-8234306fa49e req-b973e1d1-c0b6-4231-afb0-44e9400bffec service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:43.794319 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-0ca3080f-bfbf-4837-a0a5-8234306fa49e req-b973e1d1-c0b6-4231-afb0-44e9400bffec service nova] Creating event network-vif-unplugged:3874b623-0ac2-47e5-88e0-78f207e051a4 for instance 52cd9b3e-aa05-41f0-b17a-d78f06e5d176 on hv-cinder-85200 Aug 10 13:46:43.799422 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-0ca3080f-bfbf-4837-a0a5-8234306fa49e req-b973e1d1-c0b6-4231-afb0-44e9400bffec service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035878 Aug 10 13:46:43.800131 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 456/939] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:46:44.408242 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-b8ee6c0c-c918-4ee8-9ef6-befe501db15e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:46:44.408863 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-b8ee6c0c-c918-4ee8-9ef6-befe501db15e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:46:44.415643 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b8ee6c0c-c918-4ee8-9ef6-befe501db15e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:44.416120 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b8ee6c0c-c918-4ee8-9ef6-befe501db15e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:44.416546 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b8ee6c0c-c918-4ee8-9ef6-befe501db15e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:44.417369 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b8ee6c0c-c918-4ee8-9ef6-befe501db15e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:44.417816 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b8ee6c0c-c918-4ee8-9ef6-befe501db15e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:44.418237 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b8ee6c0c-c918-4ee8-9ef6-befe501db15e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:44.554343 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-b8ee6c0c-c918-4ee8-9ef6-befe501db15e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:46:44.562029 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-b8ee6c0c-c918-4ee8-9ef6-befe501db15e tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1578 microversion: 2.1 time: 0.159320 Aug 10 13:46:44.562556 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 484/940] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:46:44 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:46:44.776392 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-4287a372-d36e-442d-9a19-802c568b3fc8 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:46:44.777090 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-4287a372-d36e-442d-9a19-802c568b3fc8 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:46:44.783995 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4287a372-d36e-442d-9a19-802c568b3fc8 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:44.784690 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4287a372-d36e-442d-9a19-802c568b3fc8 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:44.785135 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4287a372-d36e-442d-9a19-802c568b3fc8 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:44.785867 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4287a372-d36e-442d-9a19-802c568b3fc8 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:44.786322 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4287a372-d36e-442d-9a19-802c568b3fc8 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:44.786748 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4287a372-d36e-442d-9a19-802c568b3fc8 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:44.929836 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-4287a372-d36e-442d-9a19-802c568b3fc8 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:46:44.938110 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-4287a372-d36e-442d-9a19-802c568b3fc8 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51" status: 200 len: 1514 microversion: 2.1 time: 0.166659 Aug 10 13:46:44.938698 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 457/941] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:46:44 2022] GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:46:45.583154 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-d9686f41-e009-473f-a109-b4e6d3cf796a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:46:45.583697 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-d9686f41-e009-473f-a109-b4e6d3cf796a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:46:45.590569 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d9686f41-e009-473f-a109-b4e6d3cf796a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:45.591042 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d9686f41-e009-473f-a109-b4e6d3cf796a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:45.591468 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d9686f41-e009-473f-a109-b4e6d3cf796a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:45.592145 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d9686f41-e009-473f-a109-b4e6d3cf796a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:45.592620 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d9686f41-e009-473f-a109-b4e6d3cf796a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:45.593010 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d9686f41-e009-473f-a109-b4e6d3cf796a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:45.724235 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-d9686f41-e009-473f-a109-b4e6d3cf796a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:46:45.732469 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-d9686f41-e009-473f-a109-b4e6d3cf796a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1578 microversion: 2.1 time: 0.153251 Aug 10 13:46:45.733047 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 485/942] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:46:45 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:46:45.941725 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-8dcd86ae-1187-46b7-8aff-ed3ea3ce917c req-1d5454a2-65b1-446d-802d-11f3e02b0640 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51", "name": "network-vif-unplugged", "status": "completed", "tag": "ca3e678d-e424-476f-8d3f-420e80eab574"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:46:45.952132 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-8dcd86ae-1187-46b7-8aff-ed3ea3ce917c req-1d5454a2-65b1-446d-802d-11f3e02b0640 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:45.952639 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-8dcd86ae-1187-46b7-8aff-ed3ea3ce917c req-1d5454a2-65b1-446d-802d-11f3e02b0640 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:45.953084 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-8dcd86ae-1187-46b7-8aff-ed3ea3ce917c req-1d5454a2-65b1-446d-802d-11f3e02b0640 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:45.964883 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-8dcd86ae-1187-46b7-8aff-ed3ea3ce917c req-1d5454a2-65b1-446d-802d-11f3e02b0640 service nova] Creating event network-vif-unplugged:ca3e678d-e424-476f-8d3f-420e80eab574 for instance 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51 on hv-cinder-85200 Aug 10 13:46:45.965146 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-63990293-f28c-45a7-ae6b-e9c3eca366ce tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:46:45.966043 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-63990293-f28c-45a7-ae6b-e9c3eca366ce tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:46:45.970067 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-8dcd86ae-1187-46b7-8aff-ed3ea3ce917c req-1d5454a2-65b1-446d-802d-11f3e02b0640 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032060 Aug 10 13:46:45.970659 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 458/943] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:46:45.972404 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-63990293-f28c-45a7-ae6b-e9c3eca366ce tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:45.972978 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-63990293-f28c-45a7-ae6b-e9c3eca366ce tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:45.973461 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-63990293-f28c-45a7-ae6b-e9c3eca366ce tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:45.974152 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-63990293-f28c-45a7-ae6b-e9c3eca366ce tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:45.974597 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-63990293-f28c-45a7-ae6b-e9c3eca366ce tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:45.975011 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-63990293-f28c-45a7-ae6b-e9c3eca366ce tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:46.111239 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-63990293-f28c-45a7-ae6b-e9c3eca366ce tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:46:46.119824 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-63990293-f28c-45a7-ae6b-e9c3eca366ce tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51" status: 200 len: 1514 microversion: 2.1 time: 0.163898 Aug 10 13:46:46.120361 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 486/944] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:46:45 2022] GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:46:46.754437 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-59f5ab91-ce98-4656-a97a-ac55143aeb89 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:46:46.755055 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-59f5ab91-ce98-4656-a97a-ac55143aeb89 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:46:46.761261 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-59f5ab91-ce98-4656-a97a-ac55143aeb89 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:46.761751 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-59f5ab91-ce98-4656-a97a-ac55143aeb89 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:46.762187 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-59f5ab91-ce98-4656-a97a-ac55143aeb89 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:46.762871 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-59f5ab91-ce98-4656-a97a-ac55143aeb89 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:46.763326 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-59f5ab91-ce98-4656-a97a-ac55143aeb89 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:46.763750 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-59f5ab91-ce98-4656-a97a-ac55143aeb89 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:46.902222 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-59f5ab91-ce98-4656-a97a-ac55143aeb89 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:46:46.910394 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-59f5ab91-ce98-4656-a97a-ac55143aeb89 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1578 microversion: 2.1 time: 0.160236 Aug 10 13:46:46.910960 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 459/945] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:46:46 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:46:47.141776 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-f449cd9c-5865-483b-927b-95211b358876 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:46:47.142389 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-f449cd9c-5865-483b-927b-95211b358876 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:46:47.149444 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f449cd9c-5865-483b-927b-95211b358876 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:47.149923 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f449cd9c-5865-483b-927b-95211b358876 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:47.150347 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f449cd9c-5865-483b-927b-95211b358876 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:47.151032 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f449cd9c-5865-483b-927b-95211b358876 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:47.151476 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f449cd9c-5865-483b-927b-95211b358876 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:47.151890 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f449cd9c-5865-483b-927b-95211b358876 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:47.284895 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-f449cd9c-5865-483b-927b-95211b358876 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:46:47.293026 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-f449cd9c-5865-483b-927b-95211b358876 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51" status: 200 len: 1514 microversion: 2.1 time: 0.156474 Aug 10 13:46:47.293612 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 487/946] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:46:47 2022] GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:46:47.932678 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-13131878-a76e-4435-9d6d-ff2b513aeec0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:46:47.933247 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-13131878-a76e-4435-9d6d-ff2b513aeec0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:46:47.939549 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-13131878-a76e-4435-9d6d-ff2b513aeec0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:47.940028 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-13131878-a76e-4435-9d6d-ff2b513aeec0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:47.940460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-13131878-a76e-4435-9d6d-ff2b513aeec0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:47.941142 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-13131878-a76e-4435-9d6d-ff2b513aeec0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:47.941616 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-13131878-a76e-4435-9d6d-ff2b513aeec0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:47.942056 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-13131878-a76e-4435-9d6d-ff2b513aeec0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:48.079474 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-13131878-a76e-4435-9d6d-ff2b513aeec0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:46:48.087393 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-13131878-a76e-4435-9d6d-ff2b513aeec0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1578 microversion: 2.1 time: 0.159306 Aug 10 13:46:48.087952 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 460/947] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:46:47 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:46:48.314490 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-4fd505f4-78c8-4e37-9b37-e2269c7518a5 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:46:48.315100 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-4fd505f4-78c8-4e37-9b37-e2269c7518a5 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:46:48.321816 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4fd505f4-78c8-4e37-9b37-e2269c7518a5 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:48.322323 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4fd505f4-78c8-4e37-9b37-e2269c7518a5 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:48.322734 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4fd505f4-78c8-4e37-9b37-e2269c7518a5 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:48.323426 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4fd505f4-78c8-4e37-9b37-e2269c7518a5 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:48.323878 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4fd505f4-78c8-4e37-9b37-e2269c7518a5 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:48.324299 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4fd505f4-78c8-4e37-9b37-e2269c7518a5 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:48.461176 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-4fd505f4-78c8-4e37-9b37-e2269c7518a5 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:46:48.468849 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-4fd505f4-78c8-4e37-9b37-e2269c7518a5 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51" status: 200 len: 1514 microversion: 2.1 time: 0.158134 Aug 10 13:46:48.469433 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 488/948] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:46:48 2022] GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:46:49.111725 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-c7f0d03e-5333-42a0-b6bb-c8b95806ece0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:46:49.112344 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-c7f0d03e-5333-42a0-b6bb-c8b95806ece0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:46:49.118568 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c7f0d03e-5333-42a0-b6bb-c8b95806ece0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:49.119057 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c7f0d03e-5333-42a0-b6bb-c8b95806ece0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:49.119492 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c7f0d03e-5333-42a0-b6bb-c8b95806ece0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:49.120194 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c7f0d03e-5333-42a0-b6bb-c8b95806ece0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:49.120644 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c7f0d03e-5333-42a0-b6bb-c8b95806ece0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:49.121060 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c7f0d03e-5333-42a0-b6bb-c8b95806ece0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:49.257807 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-c7f0d03e-5333-42a0-b6bb-c8b95806ece0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:46:49.266178 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-c7f0d03e-5333-42a0-b6bb-c8b95806ece0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1578 microversion: 2.1 time: 0.160210 Aug 10 13:46:49.266839 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 461/949] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:46:49 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:46:49.491466 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-0f892228-2efc-40a1-9695-96387d140f77 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:46:49.492199 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-0f892228-2efc-40a1-9695-96387d140f77 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:46:49.499484 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0f892228-2efc-40a1-9695-96387d140f77 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:49.499972 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0f892228-2efc-40a1-9695-96387d140f77 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:49.500399 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0f892228-2efc-40a1-9695-96387d140f77 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:49.501096 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0f892228-2efc-40a1-9695-96387d140f77 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:49.501666 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0f892228-2efc-40a1-9695-96387d140f77 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:49.502082 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0f892228-2efc-40a1-9695-96387d140f77 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:49.639754 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-0f892228-2efc-40a1-9695-96387d140f77 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:46:49.647384 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-0f892228-2efc-40a1-9695-96387d140f77 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51" status: 200 len: 1514 microversion: 2.1 time: 0.161027 Aug 10 13:46:49.647957 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 489/950] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:46:49 2022] GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:46:50.289097 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-70117ee3-31d2-48bb-81e6-a4fd93f9d981 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:46:50.290269 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-70117ee3-31d2-48bb-81e6-a4fd93f9d981 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:46:50.296812 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-70117ee3-31d2-48bb-81e6-a4fd93f9d981 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:50.297328 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-70117ee3-31d2-48bb-81e6-a4fd93f9d981 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:50.297762 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-70117ee3-31d2-48bb-81e6-a4fd93f9d981 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:50.298455 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-70117ee3-31d2-48bb-81e6-a4fd93f9d981 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:50.298902 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-70117ee3-31d2-48bb-81e6-a4fd93f9d981 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:50.299317 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-70117ee3-31d2-48bb-81e6-a4fd93f9d981 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:50.442599 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-70117ee3-31d2-48bb-81e6-a4fd93f9d981 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:46:50.450901 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-70117ee3-31d2-48bb-81e6-a4fd93f9d981 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1578 microversion: 2.1 time: 0.166602 Aug 10 13:46:50.451470 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 462/951] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:46:50 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:46:50.668638 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-a94ec3d9-63ae-46e0-8968-12a15d8610b7 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:46:50.669572 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-a94ec3d9-63ae-46e0-8968-12a15d8610b7 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:46:50.676420 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a94ec3d9-63ae-46e0-8968-12a15d8610b7 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:50.676902 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a94ec3d9-63ae-46e0-8968-12a15d8610b7 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:50.677368 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a94ec3d9-63ae-46e0-8968-12a15d8610b7 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:50.678062 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a94ec3d9-63ae-46e0-8968-12a15d8610b7 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:50.678513 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a94ec3d9-63ae-46e0-8968-12a15d8610b7 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:50.678931 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a94ec3d9-63ae-46e0-8968-12a15d8610b7 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:50.813457 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-a94ec3d9-63ae-46e0-8968-12a15d8610b7 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:46:50.821489 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-a94ec3d9-63ae-46e0-8968-12a15d8610b7 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51" status: 200 len: 1514 microversion: 2.1 time: 0.156236 Aug 10 13:46:50.822058 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 490/952] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:46:50 2022] GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:46:51.473448 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-c3d71d43-66da-4a34-b160-3bcf38c1828c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:46:51.474466 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-c3d71d43-66da-4a34-b160-3bcf38c1828c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:46:51.484231 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c3d71d43-66da-4a34-b160-3bcf38c1828c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:51.484714 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c3d71d43-66da-4a34-b160-3bcf38c1828c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:51.485148 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c3d71d43-66da-4a34-b160-3bcf38c1828c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:51.486008 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c3d71d43-66da-4a34-b160-3bcf38c1828c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:51.486768 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c3d71d43-66da-4a34-b160-3bcf38c1828c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:51.487285 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c3d71d43-66da-4a34-b160-3bcf38c1828c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:51.657957 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-c3d71d43-66da-4a34-b160-3bcf38c1828c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:46:51.668832 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-c3d71d43-66da-4a34-b160-3bcf38c1828c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1578 microversion: 2.1 time: 0.199348 Aug 10 13:46:51.669610 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 463/953] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:46:51 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1578 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:46:51.843464 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-6a23b377-258d-4e5b-a00b-ce896720bcee tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:46:51.844018 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-6a23b377-258d-4e5b-a00b-ce896720bcee tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:46:51.851879 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6a23b377-258d-4e5b-a00b-ce896720bcee tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:51.852913 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6a23b377-258d-4e5b-a00b-ce896720bcee tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:51.853375 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6a23b377-258d-4e5b-a00b-ce896720bcee tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:51.854081 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6a23b377-258d-4e5b-a00b-ce896720bcee tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:51.854530 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6a23b377-258d-4e5b-a00b-ce896720bcee tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:51.854954 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-6a23b377-258d-4e5b-a00b-ce896720bcee tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:52.009440 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-6a23b377-258d-4e5b-a00b-ce896720bcee tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:46:52.017207 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-6a23b377-258d-4e5b-a00b-ce896720bcee tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51" status: 200 len: 1514 microversion: 2.1 time: 0.177711 Aug 10 13:46:52.017818 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 491/954] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:46:51 2022] GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51 => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:46:52.694919 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-98a74200-d9bc-4f1d-8f3e-860f2ba9f104 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:46:52.696638 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-98a74200-d9bc-4f1d-8f3e-860f2ba9f104 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:46:52.704325 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-98a74200-d9bc-4f1d-8f3e-860f2ba9f104 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:52.704813 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-98a74200-d9bc-4f1d-8f3e-860f2ba9f104 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:52.705272 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-98a74200-d9bc-4f1d-8f3e-860f2ba9f104 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:52.705979 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-98a74200-d9bc-4f1d-8f3e-860f2ba9f104 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:52.706446 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-98a74200-d9bc-4f1d-8f3e-860f2ba9f104 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:52.706857 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-98a74200-d9bc-4f1d-8f3e-860f2ba9f104 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:52.726119 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:46:52.861498 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-98a74200-d9bc-4f1d-8f3e-860f2ba9f104 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:46:52.870210 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-98a74200-d9bc-4f1d-8f3e-860f2ba9f104 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1578 microversion: 2.1 time: 0.182744 Aug 10 13:46:52.870791 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 464/955] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:46:52 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1578 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:46:53.038862 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-e5f096bf-8155-4779-ae7a-1f0baa489ede tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:46:53.040023 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-e5f096bf-8155-4779-ae7a-1f0baa489ede tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:46:53.046581 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e5f096bf-8155-4779-ae7a-1f0baa489ede tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:53.047056 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e5f096bf-8155-4779-ae7a-1f0baa489ede tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:53.047485 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e5f096bf-8155-4779-ae7a-1f0baa489ede tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:53.048173 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e5f096bf-8155-4779-ae7a-1f0baa489ede tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:53.048619 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e5f096bf-8155-4779-ae7a-1f0baa489ede tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:53.049036 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e5f096bf-8155-4779-ae7a-1f0baa489ede tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:53.069043 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:46:53.192764 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-e5f096bf-8155-4779-ae7a-1f0baa489ede tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:46:53.200962 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-e5f096bf-8155-4779-ae7a-1f0baa489ede tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51" status: 200 len: 1514 microversion: 2.1 time: 0.166101 Aug 10 13:46:53.201568 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 492/956] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:46:53 2022] GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:46:53.903456 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-86725e6d-2132-4626-94aa-69cf24b06369 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:46:53.904342 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-86725e6d-2132-4626-94aa-69cf24b06369 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:46:53.911071 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-86725e6d-2132-4626-94aa-69cf24b06369 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:53.911571 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-86725e6d-2132-4626-94aa-69cf24b06369 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:53.912066 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-86725e6d-2132-4626-94aa-69cf24b06369 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:53.912770 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-86725e6d-2132-4626-94aa-69cf24b06369 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:53.913433 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-86725e6d-2132-4626-94aa-69cf24b06369 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:53.913810 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-86725e6d-2132-4626-94aa-69cf24b06369 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:54.054215 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-86725e6d-2132-4626-94aa-69cf24b06369 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:46:54.063006 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-86725e6d-2132-4626-94aa-69cf24b06369 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1578 microversion: 2.1 time: 0.163400 Aug 10 13:46:54.063581 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 465/957] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:46:53 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:46:54.223439 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-451296b6-290b-45c3-8922-df3db6871a9a tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:46:54.224292 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-451296b6-290b-45c3-8922-df3db6871a9a tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:46:54.231859 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-451296b6-290b-45c3-8922-df3db6871a9a tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:54.232530 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-451296b6-290b-45c3-8922-df3db6871a9a tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:54.233214 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-451296b6-290b-45c3-8922-df3db6871a9a tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:54.234560 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-451296b6-290b-45c3-8922-df3db6871a9a tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:54.235129 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-451296b6-290b-45c3-8922-df3db6871a9a tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:54.235666 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-451296b6-290b-45c3-8922-df3db6871a9a tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:54.487341 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-451296b6-290b-45c3-8922-df3db6871a9a tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:46:54.498367 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-451296b6-290b-45c3-8922-df3db6871a9a tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51" status: 200 len: 1514 microversion: 2.1 time: 0.278698 Aug 10 13:46:54.499002 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 493/958] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:46:54 2022] GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51 => generated 1514 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:46:55.088139 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-6bb6e9ac-5eba-4db6-bb00-0b5e4c831e75 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:46:55.089276 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-6bb6e9ac-5eba-4db6-bb00-0b5e4c831e75 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:46:55.101279 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6bb6e9ac-5eba-4db6-bb00-0b5e4c831e75 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:55.102186 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6bb6e9ac-5eba-4db6-bb00-0b5e4c831e75 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:55.103216 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6bb6e9ac-5eba-4db6-bb00-0b5e4c831e75 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:55.104436 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6bb6e9ac-5eba-4db6-bb00-0b5e4c831e75 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:55.105213 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6bb6e9ac-5eba-4db6-bb00-0b5e4c831e75 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:55.106197 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6bb6e9ac-5eba-4db6-bb00-0b5e4c831e75 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:55.395339 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-6bb6e9ac-5eba-4db6-bb00-0b5e4c831e75 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:46:55.405955 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-6bb6e9ac-5eba-4db6-bb00-0b5e4c831e75 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1459 microversion: 2.1 time: 0.325343 Aug 10 13:46:55.406686 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 466/959] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:46:55 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1459 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:46:55.530031 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-c087c391-f255-4f8c-9064-ffed220892fd tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:46:55.531841 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-c087c391-f255-4f8c-9064-ffed220892fd tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:46:55.550979 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-df7f27a0-6c8f-4aed-ae02-d71a25ab313d req-880aacfd-4fc4-4dc4-8f17-fc5f06509f86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51", "name": "network-vif-deleted", "tag": "ca3e678d-e424-476f-8d3f-420e80eab574"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:46:55.579054 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-df7f27a0-6c8f-4aed-ae02-d71a25ab313d req-880aacfd-4fc4-4dc4-8f17-fc5f06509f86 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:55.580287 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c087c391-f255-4f8c-9064-ffed220892fd tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:55.581767 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-df7f27a0-6c8f-4aed-ae02-d71a25ab313d req-880aacfd-4fc4-4dc4-8f17-fc5f06509f86 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:55.582495 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c087c391-f255-4f8c-9064-ffed220892fd tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:55.583210 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-df7f27a0-6c8f-4aed-ae02-d71a25ab313d req-880aacfd-4fc4-4dc4-8f17-fc5f06509f86 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:55.584607 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c087c391-f255-4f8c-9064-ffed220892fd tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:55.598440 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c087c391-f255-4f8c-9064-ffed220892fd tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:55.598997 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c087c391-f255-4f8c-9064-ffed220892fd tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:55.599513 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c087c391-f255-4f8c-9064-ffed220892fd tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:55.642676 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-df7f27a0-6c8f-4aed-ae02-d71a25ab313d req-880aacfd-4fc4-4dc4-8f17-fc5f06509f86 service nova] Creating event network-vif-deleted:ca3e678d-e424-476f-8d3f-420e80eab574 for instance 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51 on hv-cinder-85200 Aug 10 13:46:55.659739 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-df7f27a0-6c8f-4aed-ae02-d71a25ab313d req-880aacfd-4fc4-4dc4-8f17-fc5f06509f86 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108364 Aug 10 13:46:55.661212 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 467/960] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:46:55.733288 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-c087c391-f255-4f8c-9064-ffed220892fd tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:46:55.744301 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-c087c391-f255-4f8c-9064-ffed220892fd tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51" status: 200 len: 1304 microversion: 2.1 time: 0.224103 Aug 10 13:46:55.745620 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 494/961] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:46:55 2022] GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51 => generated 1304 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:46:56.438436 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-155a8645-64a1-433d-b6a0-1a52a194ebd0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:46:56.439130 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-155a8645-64a1-433d-b6a0-1a52a194ebd0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:46:56.445315 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-155a8645-64a1-433d-b6a0-1a52a194ebd0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:56.446327 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-155a8645-64a1-433d-b6a0-1a52a194ebd0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:56.446765 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-155a8645-64a1-433d-b6a0-1a52a194ebd0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:56.447455 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-155a8645-64a1-433d-b6a0-1a52a194ebd0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:56.447903 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-155a8645-64a1-433d-b6a0-1a52a194ebd0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:56.448325 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-155a8645-64a1-433d-b6a0-1a52a194ebd0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:56.514888 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-155a8645-64a1-433d-b6a0-1a52a194ebd0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:46:56.527246 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-155a8645-64a1-433d-b6a0-1a52a194ebd0 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1225 microversion: 2.1 time: 0.093364 Aug 10 13:46:56.528177 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 468/962] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:46:56 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:46:56.768860 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-38708885-7460-4790-9ca3-0dd6718877c8 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:46:56.769439 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-38708885-7460-4790-9ca3-0dd6718877c8 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:46:56.776474 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-38708885-7460-4790-9ca3-0dd6718877c8 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:56.777003 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-38708885-7460-4790-9ca3-0dd6718877c8 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:56.777451 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-38708885-7460-4790-9ca3-0dd6718877c8 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:56.778140 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-38708885-7460-4790-9ca3-0dd6718877c8 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:56.778591 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-38708885-7460-4790-9ca3-0dd6718877c8 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:56.779014 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-38708885-7460-4790-9ca3-0dd6718877c8 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:56.792740 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.wsgi [None req-38708885-7460-4790-9ca3-0dd6718877c8 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] HTTP exception thrown: Instance 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51 could not be found. Aug 10 13:46:56.794474 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-38708885-7460-4790-9ca3-0dd6718877c8 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Request method failure captured: Aug 10 13:46:56.794474 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: request: GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51 HTTP/1.1 Aug 10 13:46:56.794474 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept: application/json Aug 10 13:46:56.794474 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept-Encoding: identity Aug 10 13:46:56.794474 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Connection: close Aug 10 13:46:56.794474 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Length: 0 Aug 10 13:46:56.794474 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Type: application/json Aug 10 13:46:56.794474 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Host: 10.222.0.52 Aug 10 13:46:56.794474 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Openstack-System-Scope: None Aug 10 13:46:56.794474 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: User-Agent: python-urllib3/1.26.11 Aug 10 13:46:56.794474 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Auth-Token: gAAAAABi87Z0KjBe8kPGBxUYhNqk4l_P-9dBXG9gSgFsEaKt9RpWq_Aop_rJXmSzxcSzrvM1VPnxx6U64IzIUMvVlFsbgeqqCRzmYNHR6ZMJTxqE8Ox3AM4JQJfqk42Vjw2rPwtSSc8WnLBodNZzmv78sHXSUUtwdV6Vc86HuXSaektfKpGcpJA Aug 10 13:46:56.794474 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Id: None Aug 10 13:46:56.794474 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Name: None Aug 10 13:46:56.794474 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Identity-Status: Confirmed Aug 10 13:46:56.794474 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Is-Admin-Project: True Aug 10 13:46:56.794474 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Id: default Aug 10 13:46:56.794474 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Name: Default Aug 10 13:46:56.794474 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Id: bf531c40d3f74fa6aaf3d26794dca09c Aug 10 13:46:56.794474 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1110532079 Aug 10 13:46:56.794474 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Role: member,reader Aug 10 13:46:56.794474 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Roles: member,reader Aug 10 13:46:56.796119 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bf531c40d3f74fa6aaf3d26794dca09c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bf531c40d3f74fa6aaf3d26794dca09c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bf531c40d3f74fa6aaf3d26794dca09c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bf531c40d3f74fa6aaf3d26794dca09c"}]}] Aug 10 13:46:56.796119 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant: tempest-VolumesSnapshotTestJSON-1110532079 Aug 10 13:46:56.796119 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Id: bf531c40d3f74fa6aaf3d26794dca09c Aug 10 13:46:56.796119 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1110532079 Aug 10 13:46:56.796119 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User: tempest-VolumesSnapshotTestJSON-1110532079-project Aug 10 13:46:56.796119 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Id: default Aug 10 13:46:56.796119 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Name: Default Aug 10 13:46:56.796119 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Id: 0968c56b8be242918903711961b6d5c0 Aug 10 13:46:56.796119 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Name: tempest-VolumesSnapshotTestJSON-1110532079-project Aug 10 13:46:56.796119 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: method: > Aug 10 13:46:56.796119 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: exception: Instance 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51 could not be found. Aug 10 13:46:56.796119 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: action_args: {'id': '8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51'} Aug 10 13:46:56.797180 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:46:56.797180 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:46:56.797180 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:46:56.797180 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:46:56.797180 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:46:56.797180 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:46:56.797180 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:46:56.797180 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:46:56.797180 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:46:56.797180 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:46:56.797180 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51 could not be found. Aug 10 13:46:56.797180 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:46:56.797180 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:46:56.797180 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:46:56.797180 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:46:56.797180 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:46:56.797180 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:46:56.797180 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:46:56.797180 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:46:56.797180 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:46:56.799305 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:46:56.799305 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:46:56.799305 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:46:56.799305 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:46:56.799305 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:46:56.799305 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:46:56.799305 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:46:56.799305 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51 could not be found. Aug 10 13:46:56.799305 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:46:56.799305 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:46:56.799305 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:46:56.799305 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:46:56.799305 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:46:56.799305 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:46:56.799305 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:46:56.799305 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:46:56.799305 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51 could not be found. Aug 10 13:46:56.799305 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:46:56.801926 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-38708885-7460-4790-9ca3-0dd6718877c8 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Returning 404 to user: Instance 8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51 could not be found. {{(pid=129522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:46:56.801926 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-38708885-7460-4790-9ca3-0dd6718877c8 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51" status: 404 len: 111 microversion: 2.1 time: 0.031465 Aug 10 13:46:56.801926 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 495/963] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:46:56 2022] GET /compute/v2.1/servers/8eae95dc-b75e-4c7e-bf9a-c840b6cb7d51 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:46:57.551270 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-b6dd8c78-595e-4290-9fc1-d6f6be327ad4 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:46:57.551857 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-b6dd8c78-595e-4290-9fc1-d6f6be327ad4 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:46:57.558911 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b6dd8c78-595e-4290-9fc1-d6f6be327ad4 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:57.559440 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b6dd8c78-595e-4290-9fc1-d6f6be327ad4 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:57.559872 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b6dd8c78-595e-4290-9fc1-d6f6be327ad4 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:57.560561 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b6dd8c78-595e-4290-9fc1-d6f6be327ad4 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:57.561011 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b6dd8c78-595e-4290-9fc1-d6f6be327ad4 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:57.561462 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b6dd8c78-595e-4290-9fc1-d6f6be327ad4 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:57.626658 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-b6dd8c78-595e-4290-9fc1-d6f6be327ad4 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:46:57.634445 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-b6dd8c78-595e-4290-9fc1-d6f6be327ad4 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1225 microversion: 2.1 time: 0.087127 Aug 10 13:46:57.635013 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 469/964] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:46:57 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:46:57.699536 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-54efd191-e4bf-4a75-b405-c3623e1998a4 req-98b510e7-0c0d-4062-a083-8f2d5ca30399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52cd9b3e-aa05-41f0-b17a-d78f06e5d176", "name": "network-vif-deleted", "tag": "3874b623-0ac2-47e5-88e0-78f207e051a4"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:46:57.708972 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-54efd191-e4bf-4a75-b405-c3623e1998a4 req-98b510e7-0c0d-4062-a083-8f2d5ca30399 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:57.709488 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-54efd191-e4bf-4a75-b405-c3623e1998a4 req-98b510e7-0c0d-4062-a083-8f2d5ca30399 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:57.709919 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-54efd191-e4bf-4a75-b405-c3623e1998a4 req-98b510e7-0c0d-4062-a083-8f2d5ca30399 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:57.720640 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-54efd191-e4bf-4a75-b405-c3623e1998a4 req-98b510e7-0c0d-4062-a083-8f2d5ca30399 service nova] Creating event network-vif-deleted:3874b623-0ac2-47e5-88e0-78f207e051a4 for instance 52cd9b3e-aa05-41f0-b17a-d78f06e5d176 on hv-cinder-85200 Aug 10 13:46:57.725484 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-54efd191-e4bf-4a75-b405-c3623e1998a4 req-98b510e7-0c0d-4062-a083-8f2d5ca30399 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029633 Aug 10 13:46:57.726046 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 496/965] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:46:58.655889 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-fe1b6fd6-2d22-408e-8fc1-2f929a7449e3 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:46:58.656550 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-fe1b6fd6-2d22-408e-8fc1-2f929a7449e3 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:46:58.663012 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-fe1b6fd6-2d22-408e-8fc1-2f929a7449e3 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:58.663490 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-fe1b6fd6-2d22-408e-8fc1-2f929a7449e3 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:58.663921 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-fe1b6fd6-2d22-408e-8fc1-2f929a7449e3 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:58.664658 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-fe1b6fd6-2d22-408e-8fc1-2f929a7449e3 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:58.665104 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-fe1b6fd6-2d22-408e-8fc1-2f929a7449e3 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:58.665549 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-fe1b6fd6-2d22-408e-8fc1-2f929a7449e3 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:58.734341 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-fe1b6fd6-2d22-408e-8fc1-2f929a7449e3 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:46:58.745822 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-fe1b6fd6-2d22-408e-8fc1-2f929a7449e3 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1225 microversion: 2.1 time: 0.093764 Aug 10 13:46:58.746427 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 470/966] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:46:58 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:46:59.768430 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-cfa200cd-14af-4af3-89cc-7bdc4e69d342 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:46:59.769468 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-cfa200cd-14af-4af3-89cc-7bdc4e69d342 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:46:59.776615 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cfa200cd-14af-4af3-89cc-7bdc4e69d342 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:59.777095 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cfa200cd-14af-4af3-89cc-7bdc4e69d342 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:59.777571 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cfa200cd-14af-4af3-89cc-7bdc4e69d342 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:59.778284 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cfa200cd-14af-4af3-89cc-7bdc4e69d342 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:46:59.778718 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cfa200cd-14af-4af3-89cc-7bdc4e69d342 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:46:59.779140 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cfa200cd-14af-4af3-89cc-7bdc4e69d342 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:46:59.844468 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-cfa200cd-14af-4af3-89cc-7bdc4e69d342 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:46:59.852312 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-cfa200cd-14af-4af3-89cc-7bdc4e69d342 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1225 microversion: 2.1 time: 0.088819 Aug 10 13:46:59.852875 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 497/967] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:46:59 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:47:00.873390 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-dae5ab6c-4a1c-4b33-b220-c5f0dc20adf5 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:00.874239 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-dae5ab6c-4a1c-4b33-b220-c5f0dc20adf5 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:00.880631 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-dae5ab6c-4a1c-4b33-b220-c5f0dc20adf5 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:00.881118 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-dae5ab6c-4a1c-4b33-b220-c5f0dc20adf5 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:00.881586 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-dae5ab6c-4a1c-4b33-b220-c5f0dc20adf5 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:00.882293 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-dae5ab6c-4a1c-4b33-b220-c5f0dc20adf5 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:00.882753 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-dae5ab6c-4a1c-4b33-b220-c5f0dc20adf5 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:00.883683 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-dae5ab6c-4a1c-4b33-b220-c5f0dc20adf5 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:00.963639 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-dae5ab6c-4a1c-4b33-b220-c5f0dc20adf5 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:47:00.973961 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-dae5ab6c-4a1c-4b33-b220-c5f0dc20adf5 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1225 microversion: 2.1 time: 0.104643 Aug 10 13:47:00.974537 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 471/968] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:47:00 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:47:01.995605 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-cf5f83ae-b9f6-4343-8a51-58446efebf4a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:01.996277 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-cf5f83ae-b9f6-4343-8a51-58446efebf4a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:02.003160 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cf5f83ae-b9f6-4343-8a51-58446efebf4a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:02.003643 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cf5f83ae-b9f6-4343-8a51-58446efebf4a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:02.004069 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cf5f83ae-b9f6-4343-8a51-58446efebf4a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:02.004768 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cf5f83ae-b9f6-4343-8a51-58446efebf4a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:02.005218 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cf5f83ae-b9f6-4343-8a51-58446efebf4a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:02.005676 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cf5f83ae-b9f6-4343-8a51-58446efebf4a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:02.073827 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-cf5f83ae-b9f6-4343-8a51-58446efebf4a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:47:02.081841 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-cf5f83ae-b9f6-4343-8a51-58446efebf4a tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1225 microversion: 2.1 time: 0.090466 Aug 10 13:47:02.082515 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 498/969] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:47:01 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:47:03.102507 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-9e936d9c-2939-43f0-851a-472e3e759014 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:03.103070 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-9e936d9c-2939-43f0-851a-472e3e759014 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:03.110007 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9e936d9c-2939-43f0-851a-472e3e759014 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:03.110502 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9e936d9c-2939-43f0-851a-472e3e759014 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:03.110938 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9e936d9c-2939-43f0-851a-472e3e759014 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:03.111642 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9e936d9c-2939-43f0-851a-472e3e759014 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:03.112097 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9e936d9c-2939-43f0-851a-472e3e759014 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:03.112519 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9e936d9c-2939-43f0-851a-472e3e759014 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:03.145466 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9e936d9c-2939-43f0-851a-472e3e759014 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:03.145945 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9e936d9c-2939-43f0-851a-472e3e759014 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:03.146375 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-9e936d9c-2939-43f0-851a-472e3e759014 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:03.146822 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.objects.instance [None req-9e936d9c-2939-43f0-851a-472e3e759014 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lazy-loading 'fault' on Instance uuid 52cd9b3e-aa05-41f0-b17a-d78f06e5d176 {{(pid=129523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:47:03.193621 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-9e936d9c-2939-43f0-851a-472e3e759014 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:47:03.202177 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-9e936d9c-2939-43f0-851a-472e3e759014 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1230 microversion: 2.1 time: 0.103828 Aug 10 13:47:03.202762 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 472/970] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:47:03 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1230 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:47:04.230534 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-19efc68a-fae2-47e5-aad1-7e98b2ebbce7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:04.231791 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-19efc68a-fae2-47e5-aad1-7e98b2ebbce7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:04.245997 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-19efc68a-fae2-47e5-aad1-7e98b2ebbce7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:04.246933 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-19efc68a-fae2-47e5-aad1-7e98b2ebbce7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:04.247693 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-19efc68a-fae2-47e5-aad1-7e98b2ebbce7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:04.249126 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-19efc68a-fae2-47e5-aad1-7e98b2ebbce7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:04.250045 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-19efc68a-fae2-47e5-aad1-7e98b2ebbce7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:04.251048 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-19efc68a-fae2-47e5-aad1-7e98b2ebbce7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:04.295445 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-19efc68a-fae2-47e5-aad1-7e98b2ebbce7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:04.295931 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-19efc68a-fae2-47e5-aad1-7e98b2ebbce7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:04.296369 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-19efc68a-fae2-47e5-aad1-7e98b2ebbce7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:04.296829 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.objects.instance [None req-19efc68a-fae2-47e5-aad1-7e98b2ebbce7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lazy-loading 'fault' on Instance uuid 52cd9b3e-aa05-41f0-b17a-d78f06e5d176 {{(pid=129522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:47:04.349948 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-19efc68a-fae2-47e5-aad1-7e98b2ebbce7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:47:04.358939 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-19efc68a-fae2-47e5-aad1-7e98b2ebbce7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1230 microversion: 2.1 time: 0.136661 Aug 10 13:47:04.359532 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 499/971] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:47:04 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1230 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:47:05.382551 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-b30436fd-ea04-4928-9777-f90fe75f56de tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:05.383663 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-b30436fd-ea04-4928-9777-f90fe75f56de tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:05.390810 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b30436fd-ea04-4928-9777-f90fe75f56de tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:05.391303 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b30436fd-ea04-4928-9777-f90fe75f56de tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:05.391742 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b30436fd-ea04-4928-9777-f90fe75f56de tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:05.392474 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b30436fd-ea04-4928-9777-f90fe75f56de tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:05.392968 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b30436fd-ea04-4928-9777-f90fe75f56de tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:05.393447 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b30436fd-ea04-4928-9777-f90fe75f56de tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:05.425192 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b30436fd-ea04-4928-9777-f90fe75f56de tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:05.425707 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b30436fd-ea04-4928-9777-f90fe75f56de tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:05.426151 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b30436fd-ea04-4928-9777-f90fe75f56de tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:05.426598 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.objects.instance [None req-b30436fd-ea04-4928-9777-f90fe75f56de tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lazy-loading 'fault' on Instance uuid 52cd9b3e-aa05-41f0-b17a-d78f06e5d176 {{(pid=129523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:47:05.469092 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-b30436fd-ea04-4928-9777-f90fe75f56de tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:47:05.476766 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-b30436fd-ea04-4928-9777-f90fe75f56de tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 200 len: 1230 microversion: 2.1 time: 0.099528 Aug 10 13:47:05.477433 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 473/972] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:47:05 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 1230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:47:06.496983 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-898d8771-daa5-4800-bae1-7a09486e0d6c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:06.497585 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-898d8771-daa5-4800-bae1-7a09486e0d6c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 52cd9b3e-aa05-41f0-b17a-d78f06e5d176] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:06.504162 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-898d8771-daa5-4800-bae1-7a09486e0d6c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:06.504629 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-898d8771-daa5-4800-bae1-7a09486e0d6c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:06.504992 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-898d8771-daa5-4800-bae1-7a09486e0d6c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:06.505727 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-898d8771-daa5-4800-bae1-7a09486e0d6c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:06.506188 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-898d8771-daa5-4800-bae1-7a09486e0d6c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:06.506611 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-898d8771-daa5-4800-bae1-7a09486e0d6c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:06.520988 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.wsgi [None req-898d8771-daa5-4800-bae1-7a09486e0d6c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] HTTP exception thrown: Instance 52cd9b3e-aa05-41f0-b17a-d78f06e5d176 could not be found. Aug 10 13:47:06.522787 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-898d8771-daa5-4800-bae1-7a09486e0d6c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Request method failure captured: Aug 10 13:47:06.522787 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: request: GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 HTTP/1.1 Aug 10 13:47:06.522787 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept: application/json Aug 10 13:47:06.522787 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept-Encoding: identity Aug 10 13:47:06.522787 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Connection: close Aug 10 13:47:06.522787 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Length: 0 Aug 10 13:47:06.522787 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Type: application/json Aug 10 13:47:06.522787 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Host: 10.222.0.52 Aug 10 13:47:06.522787 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Openstack-System-Scope: None Aug 10 13:47:06.522787 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: User-Agent: python-urllib3/1.26.11 Aug 10 13:47:06.522787 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Auth-Token: gAAAAABi87TSzxP2-YwwzoVQUCaIGZpUao_F-X-e3X9CWe3aw04cqEa58UtxCos4r-Q3NFdtiQhGTNowwWExRyEAyMlYgP4tsLTK5yzvxfKVpqHSHKFu7wTq3iH51AqunAJMGmD2Ry377K0xwLIwG9QqTwzXWE-7Zp72mPPCiwxzQiXyh6jtvqI Aug 10 13:47:06.522787 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Id: None Aug 10 13:47:06.522787 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Name: None Aug 10 13:47:06.522787 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Identity-Status: Confirmed Aug 10 13:47:06.522787 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Is-Admin-Project: True Aug 10 13:47:06.522787 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Id: default Aug 10 13:47:06.522787 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Name: Default Aug 10 13:47:06.522787 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Id: b52f008781f64d09b706d478c8fe8922 Aug 10 13:47:06.522787 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Name: tempest-TestVolumeBootPattern-1665317784 Aug 10 13:47:06.522787 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Role: member,reader Aug 10 13:47:06.522787 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Roles: member,reader Aug 10 13:47:06.524895 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b52f008781f64d09b706d478c8fe8922"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b52f008781f64d09b706d478c8fe8922"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b52f008781f64d09b706d478c8fe8922", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b52f008781f64d09b706d478c8fe8922"}]}] Aug 10 13:47:06.524895 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant: tempest-TestVolumeBootPattern-1665317784 Aug 10 13:47:06.524895 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Id: b52f008781f64d09b706d478c8fe8922 Aug 10 13:47:06.524895 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Name: tempest-TestVolumeBootPattern-1665317784 Aug 10 13:47:06.524895 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User: tempest-TestVolumeBootPattern-1665317784-project Aug 10 13:47:06.524895 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Id: default Aug 10 13:47:06.524895 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Name: Default Aug 10 13:47:06.524895 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Id: 411ff3f0306848ee91108343982806ca Aug 10 13:47:06.524895 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Name: tempest-TestVolumeBootPattern-1665317784-project Aug 10 13:47:06.524895 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: method: > Aug 10 13:47:06.524895 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: exception: Instance 52cd9b3e-aa05-41f0-b17a-d78f06e5d176 could not be found. Aug 10 13:47:06.524895 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: action_args: {'id': '52cd9b3e-aa05-41f0-b17a-d78f06e5d176'} Aug 10 13:47:06.525801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:47:06.525801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:47:06.525801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:47:06.525801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:47:06.525801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:47:06.525801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:47:06.525801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:47:06.525801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:47:06.525801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:47:06.525801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:47:06.525801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52cd9b3e-aa05-41f0-b17a-d78f06e5d176 could not be found. Aug 10 13:47:06.525801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:47:06.525801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:47:06.525801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:47:06.525801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:47:06.525801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:47:06.525801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:47:06.525801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:47:06.525801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:47:06.525801 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:47:06.527561 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:47:06.527561 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:47:06.527561 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:47:06.527561 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:47:06.527561 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:47:06.527561 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:47:06.527561 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:47:06.527561 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52cd9b3e-aa05-41f0-b17a-d78f06e5d176 could not be found. Aug 10 13:47:06.527561 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:47:06.527561 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:47:06.527561 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:47:06.527561 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:47:06.527561 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:47:06.527561 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:47:06.527561 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:47:06.527561 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:47:06.527561 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52cd9b3e-aa05-41f0-b17a-d78f06e5d176 could not be found. Aug 10 13:47:06.527561 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:47:06.529594 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-898d8771-daa5-4800-bae1-7a09486e0d6c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Returning 404 to user: Instance 52cd9b3e-aa05-41f0-b17a-d78f06e5d176 could not be found. {{(pid=129522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:47:06.529594 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-898d8771-daa5-4800-bae1-7a09486e0d6c tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176" status: 404 len: 111 microversion: 2.1 time: 0.031760 Aug 10 13:47:06.529594 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 500/973] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:47:06 2022] GET /compute/v2.1/servers/52cd9b3e-aa05-41f0-b17a-d78f06e5d176 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:47:14.267172 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-c0f65aae-254d-439a-bed1-1768ac7a6406 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1557047170", "imageRef": "096d81df-12b1-4175-b914-babe0fa931c6", "flavorRef": "452", "networks": [{"uuid": "f4d88cab-1e7e-48aa-8772-126e0c18f27b"}]}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:47:14.283067 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:47:14.334601 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.network.neutron [None req-c0f65aae-254d-439a-bed1-1768ac7a6406 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] validate_networks() for [('f4d88cab-1e7e-48aa-8772-126e0c18f27b', None, None, None, None, None)] {{(pid=129523) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:47:14.873987 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-c0f65aae-254d-439a-bed1-1768ac7a6406 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Flavor limits 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:47:14.875614 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-c0f65aae-254d-439a-bed1-1768ac7a6406 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Image limits 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:47:14.877308 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-c0f65aae-254d-439a-bed1-1768ac7a6406 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Flavor pref 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:47:14.878480 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-c0f65aae-254d-439a-bed1-1768ac7a6406 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Image pref 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:47:14.879514 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-c0f65aae-254d-439a-bed1-1768ac7a6406 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:47:14.896026 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c0f65aae-254d-439a-bed1-1768ac7a6406 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:14.896925 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c0f65aae-254d-439a-bed1-1768ac7a6406 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:14.897728 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c0f65aae-254d-439a-bed1-1768ac7a6406 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:14.899628 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c0f65aae-254d-439a-bed1-1768ac7a6406 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:14.900747 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c0f65aae-254d-439a-bed1-1768ac7a6406 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:14.901523 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-c0f65aae-254d-439a-bed1-1768ac7a6406 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:14.928657 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-c0f65aae-254d-439a-bed1-1768ac7a6406 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Getting quotas for project bf531c40d3f74fa6aaf3d26794dca09c. Resources: {'cores', 'ram', 'instances'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:47:14.936280 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-c0f65aae-254d-439a-bed1-1768ac7a6406 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Getting quotas for user 0968c56b8be242918903711961b6d5c0 and project bf531c40d3f74fa6aaf3d26794dca09c. Resources: {'cores', 'ram', 'instances'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:47:14.953464 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-c0f65aae-254d-439a-bed1-1768ac7a6406 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Going to run 1 instances... {{(pid=129523) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:47:14.956047 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-c0f65aae-254d-439a-bed1-1768ac7a6406 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: ab3fe1fe-15d6-45b2-8f3a-48ea930dc815] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='096d81df-12b1-4175-b914-babe0fa931c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:47:15.008703 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-c0f65aae-254d-439a-bed1-1768ac7a6406 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.748892 Aug 10 13:47:15.009765 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 474/974] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 10 13:47:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 13:47:15.025273 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-e5db50b6-9cab-443a-83d8-7ba10788d0ba tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:15.027134 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-e5db50b6-9cab-443a-83d8-7ba10788d0ba tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: ab3fe1fe-15d6-45b2-8f3a-48ea930dc815] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:15.030956 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_api:SELECT=53 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:47:15.145726 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-e5db50b6-9cab-443a-83d8-7ba10788d0ba tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:47:15.156881 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-e5db50b6-9cab-443a-83d8-7ba10788d0ba tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815" status: 200 len: 1219 microversion: 2.1 time: 0.136903 Aug 10 13:47:15.157978 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 501/975] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:47:15 2022] GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815 => generated 1219 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:47:15.364515 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-8e59b565-a811-4615-9b70-3aa44de6f708 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:15.367603 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-2379d833-4043-4052-9f79-0c65d973e919 req-315ba828-d58b-4703-9568-bbd338390cea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "160c89f2-984e-472a-8963-eeefb63824b1", "tag": "6cf489ec-5def-460d-a9f9-421d77157738"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:47:15.370054 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-8e59b565-a811-4615-9b70-3aa44de6f708 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 160c89f2-984e-472a-8963-eeefb63824b1] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:15.386829 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8e59b565-a811-4615-9b70-3aa44de6f708 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:15.387376 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-2379d833-4043-4052-9f79-0c65d973e919 req-315ba828-d58b-4703-9568-bbd338390cea service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:15.389175 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8e59b565-a811-4615-9b70-3aa44de6f708 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:15.389838 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-2379d833-4043-4052-9f79-0c65d973e919 req-315ba828-d58b-4703-9568-bbd338390cea service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:15.390446 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8e59b565-a811-4615-9b70-3aa44de6f708 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:15.391081 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-2379d833-4043-4052-9f79-0c65d973e919 req-315ba828-d58b-4703-9568-bbd338390cea service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:15.392231 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8e59b565-a811-4615-9b70-3aa44de6f708 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:15.393476 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8e59b565-a811-4615-9b70-3aa44de6f708 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:15.395056 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8e59b565-a811-4615-9b70-3aa44de6f708 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:15.423668 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-2379d833-4043-4052-9f79-0c65d973e919 req-315ba828-d58b-4703-9568-bbd338390cea service nova] Creating event network-changed:6cf489ec-5def-460d-a9f9-421d77157738 for instance 160c89f2-984e-472a-8963-eeefb63824b1 on hv-cinder-85200 Aug 10 13:47:15.434556 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-2379d833-4043-4052-9f79-0c65d973e919 req-315ba828-d58b-4703-9568-bbd338390cea service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075807 Aug 10 13:47:15.436815 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 502/976] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:47:15.457263 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-8e59b565-a811-4615-9b70-3aa44de6f708 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 160c89f2-984e-472a-8963-eeefb63824b1] Going to try to terminate instance {{(pid=129523) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:47:15.655562 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-8e59b565-a811-4615-9b70-3aa44de6f708 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "DELETE /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1" status: 204 len: 0 microversion: 2.1 time: 0.301589 Aug 10 13:47:15.660153 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 475/977] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 10 13:47:15 2022] DELETE /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:47:15.668913 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-8d57903b-60e0-4d2e-9b47-45a08a774aa7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:15.670130 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-8d57903b-60e0-4d2e-9b47-45a08a774aa7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 160c89f2-984e-472a-8963-eeefb63824b1] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:15.677122 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8d57903b-60e0-4d2e-9b47-45a08a774aa7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:15.678030 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8d57903b-60e0-4d2e-9b47-45a08a774aa7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:15.678703 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8d57903b-60e0-4d2e-9b47-45a08a774aa7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:15.680315 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8d57903b-60e0-4d2e-9b47-45a08a774aa7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:15.681030 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8d57903b-60e0-4d2e-9b47-45a08a774aa7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:15.681734 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8d57903b-60e0-4d2e-9b47-45a08a774aa7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:15.853842 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-8d57903b-60e0-4d2e-9b47-45a08a774aa7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:47:15.863959 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-8d57903b-60e0-4d2e-9b47-45a08a774aa7 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1" status: 200 len: 1577 microversion: 2.1 time: 0.201315 Aug 10 13:47:15.875394 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 503/978] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:47:15 2022] GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1 => generated 1577 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:47:16.190371 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-1f828b91-4082-47d3-97b6-2850eb0caae7 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:16.192214 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-1f828b91-4082-47d3-97b6-2850eb0caae7 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: ab3fe1fe-15d6-45b2-8f3a-48ea930dc815] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:16.203160 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1f828b91-4082-47d3-97b6-2850eb0caae7 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:16.204138 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1f828b91-4082-47d3-97b6-2850eb0caae7 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:16.205009 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1f828b91-4082-47d3-97b6-2850eb0caae7 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:16.206561 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1f828b91-4082-47d3-97b6-2850eb0caae7 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:16.207640 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1f828b91-4082-47d3-97b6-2850eb0caae7 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:16.208566 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1f828b91-4082-47d3-97b6-2850eb0caae7 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:16.313796 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-1f828b91-4082-47d3-97b6-2850eb0caae7 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:47:16.326656 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-1f828b91-4082-47d3-97b6-2850eb0caae7 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815" status: 200 len: 1223 microversion: 2.1 time: 0.145760 Aug 10 13:47:16.327914 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 476/979] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:47:16 2022] GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815 => generated 1223 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:47:16.890210 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-9930e01d-bc1e-4622-b73e-38ba1d03bcec tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:16.891109 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-9930e01d-bc1e-4622-b73e-38ba1d03bcec tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 160c89f2-984e-472a-8963-eeefb63824b1] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:16.898746 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9930e01d-bc1e-4622-b73e-38ba1d03bcec tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:16.899498 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9930e01d-bc1e-4622-b73e-38ba1d03bcec tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:16.899935 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9930e01d-bc1e-4622-b73e-38ba1d03bcec tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:16.900814 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9930e01d-bc1e-4622-b73e-38ba1d03bcec tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:16.901301 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9930e01d-bc1e-4622-b73e-38ba1d03bcec tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:16.901732 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-9930e01d-bc1e-4622-b73e-38ba1d03bcec tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:17.094771 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-9930e01d-bc1e-4622-b73e-38ba1d03bcec tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:47:17.104043 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-9930e01d-bc1e-4622-b73e-38ba1d03bcec tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1" status: 200 len: 1577 microversion: 2.1 time: 0.218260 Aug 10 13:47:17.104619 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 504/980] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:47:16 2022] GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1 => generated 1577 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:47:17.354384 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-77dfaba1-dc4e-4eac-8b75-88cb5136a232 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:17.357155 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-77dfaba1-dc4e-4eac-8b75-88cb5136a232 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: ab3fe1fe-15d6-45b2-8f3a-48ea930dc815] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:17.369076 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-77dfaba1-dc4e-4eac-8b75-88cb5136a232 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:17.370017 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-77dfaba1-dc4e-4eac-8b75-88cb5136a232 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:17.370209 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-77dfaba1-dc4e-4eac-8b75-88cb5136a232 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:17.371177 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-77dfaba1-dc4e-4eac-8b75-88cb5136a232 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:17.371706 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-77dfaba1-dc4e-4eac-8b75-88cb5136a232 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:17.372225 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-77dfaba1-dc4e-4eac-8b75-88cb5136a232 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:17.471101 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-77dfaba1-dc4e-4eac-8b75-88cb5136a232 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:47:17.480711 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-77dfaba1-dc4e-4eac-8b75-88cb5136a232 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815" status: 200 len: 1271 microversion: 2.1 time: 0.132522 Aug 10 13:47:17.483204 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 477/981] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:47:17 2022] GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815 => generated 1271 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:47:18.129925 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-824f31ef-f908-4432-a512-ac1843e6a342 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:18.133166 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-824f31ef-f908-4432-a512-ac1843e6a342 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 160c89f2-984e-472a-8963-eeefb63824b1] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:18.152861 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-824f31ef-f908-4432-a512-ac1843e6a342 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:18.153381 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-824f31ef-f908-4432-a512-ac1843e6a342 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:18.154492 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-824f31ef-f908-4432-a512-ac1843e6a342 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:18.155214 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-824f31ef-f908-4432-a512-ac1843e6a342 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:18.155683 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-824f31ef-f908-4432-a512-ac1843e6a342 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:18.156185 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-824f31ef-f908-4432-a512-ac1843e6a342 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:18.364088 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-824f31ef-f908-4432-a512-ac1843e6a342 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:47:18.384201 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-824f31ef-f908-4432-a512-ac1843e6a342 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1" status: 200 len: 1577 microversion: 2.1 time: 0.259332 Aug 10 13:47:18.385604 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 505/982] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:47:18 2022] GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1 => generated 1577 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:47:18.506615 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-3afb671c-5c10-48e9-8ce2-a340a1d203a7 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:18.507551 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-3afb671c-5c10-48e9-8ce2-a340a1d203a7 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: ab3fe1fe-15d6-45b2-8f3a-48ea930dc815] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:18.514734 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3afb671c-5c10-48e9-8ce2-a340a1d203a7 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:18.515211 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3afb671c-5c10-48e9-8ce2-a340a1d203a7 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:18.515878 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3afb671c-5c10-48e9-8ce2-a340a1d203a7 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:18.516880 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3afb671c-5c10-48e9-8ce2-a340a1d203a7 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:18.517123 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3afb671c-5c10-48e9-8ce2-a340a1d203a7 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:18.517479 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-3afb671c-5c10-48e9-8ce2-a340a1d203a7 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:18.607049 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-3afb671c-5c10-48e9-8ce2-a340a1d203a7 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:47:18.614902 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-3afb671c-5c10-48e9-8ce2-a340a1d203a7 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815" status: 200 len: 1271 microversion: 2.1 time: 0.114288 Aug 10 13:47:18.615468 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 478/983] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:47:18 2022] GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815 => generated 1271 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:47:19.415414 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-afad0f1c-2b32-4a48-8bee-f2a932f639ee tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:19.416671 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-afad0f1c-2b32-4a48-8bee-f2a932f639ee tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 160c89f2-984e-472a-8963-eeefb63824b1] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:19.428346 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-afad0f1c-2b32-4a48-8bee-f2a932f639ee tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:19.429260 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-afad0f1c-2b32-4a48-8bee-f2a932f639ee tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:19.430007 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-afad0f1c-2b32-4a48-8bee-f2a932f639ee tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:19.431254 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-afad0f1c-2b32-4a48-8bee-f2a932f639ee tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:19.432057 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-afad0f1c-2b32-4a48-8bee-f2a932f639ee tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:19.432808 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-afad0f1c-2b32-4a48-8bee-f2a932f639ee tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:19.647086 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-59909e93-cf5a-4025-a9a0-b6ab7d63a476 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:19.648555 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-59909e93-cf5a-4025-a9a0-b6ab7d63a476 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: ab3fe1fe-15d6-45b2-8f3a-48ea930dc815] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:19.655584 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-59909e93-cf5a-4025-a9a0-b6ab7d63a476 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:19.656128 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-59909e93-cf5a-4025-a9a0-b6ab7d63a476 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:19.656528 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-59909e93-cf5a-4025-a9a0-b6ab7d63a476 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:19.657260 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-59909e93-cf5a-4025-a9a0-b6ab7d63a476 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:19.657731 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-59909e93-cf5a-4025-a9a0-b6ab7d63a476 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:19.658151 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-59909e93-cf5a-4025-a9a0-b6ab7d63a476 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:19.676118 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-afad0f1c-2b32-4a48-8bee-f2a932f639ee tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:47:19.689524 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-afad0f1c-2b32-4a48-8bee-f2a932f639ee tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1" status: 200 len: 1577 microversion: 2.1 time: 0.280147 Aug 10 13:47:19.702007 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 506/984] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:47:19 2022] GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1 => generated 1577 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:47:19.753330 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-59909e93-cf5a-4025-a9a0-b6ab7d63a476 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:47:19.768676 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-59909e93-cf5a-4025-a9a0-b6ab7d63a476 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815" status: 200 len: 1271 microversion: 2.1 time: 0.125315 Aug 10 13:47:19.769310 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 479/985] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:47:19 2022] GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815 => generated 1271 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:47:20.005106 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-2701b1f2-53c6-43aa-af07-6f7ca2250df0 req-13d8ee08-2a0a-4746-bcd5-36bbe0557759 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "160c89f2-984e-472a-8963-eeefb63824b1", "name": "network-vif-unplugged", "status": "completed", "tag": "6cf489ec-5def-460d-a9f9-421d77157738"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:47:20.022193 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-2701b1f2-53c6-43aa-af07-6f7ca2250df0 req-13d8ee08-2a0a-4746-bcd5-36bbe0557759 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:20.023483 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-2701b1f2-53c6-43aa-af07-6f7ca2250df0 req-13d8ee08-2a0a-4746-bcd5-36bbe0557759 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:20.024246 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-2701b1f2-53c6-43aa-af07-6f7ca2250df0 req-13d8ee08-2a0a-4746-bcd5-36bbe0557759 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:20.040724 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-2701b1f2-53c6-43aa-af07-6f7ca2250df0 req-13d8ee08-2a0a-4746-bcd5-36bbe0557759 service nova] Creating event network-vif-unplugged:6cf489ec-5def-460d-a9f9-421d77157738 for instance 160c89f2-984e-472a-8963-eeefb63824b1 on hv-cinder-85200 Aug 10 13:47:20.049188 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-2701b1f2-53c6-43aa-af07-6f7ca2250df0 req-13d8ee08-2a0a-4746-bcd5-36bbe0557759 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051341 Aug 10 13:47:20.050412 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 507/986] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:47:20.718713 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-83bdc2a0-0955-4a6f-aff6-6537c88c51c9 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:20.724046 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-83bdc2a0-0955-4a6f-aff6-6537c88c51c9 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 160c89f2-984e-472a-8963-eeefb63824b1] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:20.736176 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-83bdc2a0-0955-4a6f-aff6-6537c88c51c9 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:20.737045 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-83bdc2a0-0955-4a6f-aff6-6537c88c51c9 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:20.738053 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-83bdc2a0-0955-4a6f-aff6-6537c88c51c9 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:20.739255 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-83bdc2a0-0955-4a6f-aff6-6537c88c51c9 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:20.740073 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-83bdc2a0-0955-4a6f-aff6-6537c88c51c9 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:20.741071 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-83bdc2a0-0955-4a6f-aff6-6537c88c51c9 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:20.750093 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:47:20.794425 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-4414941c-7655-4cec-9eca-bce1a0249beb tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:20.795837 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-4414941c-7655-4cec-9eca-bce1a0249beb tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: ab3fe1fe-15d6-45b2-8f3a-48ea930dc815] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:20.803734 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4414941c-7655-4cec-9eca-bce1a0249beb tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:20.805033 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4414941c-7655-4cec-9eca-bce1a0249beb tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:20.805724 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4414941c-7655-4cec-9eca-bce1a0249beb tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:20.806587 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4414941c-7655-4cec-9eca-bce1a0249beb tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:20.807253 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4414941c-7655-4cec-9eca-bce1a0249beb tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:20.807977 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-4414941c-7655-4cec-9eca-bce1a0249beb tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:20.951621 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-83bdc2a0-0955-4a6f-aff6-6537c88c51c9 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:47:20.977060 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-83bdc2a0-0955-4a6f-aff6-6537c88c51c9 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1" status: 200 len: 1577 microversion: 2.1 time: 0.265306 Aug 10 13:47:20.978185 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 480/987] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:47:20 2022] GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1 => generated 1577 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:47:20.982517 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-4414941c-7655-4cec-9eca-bce1a0249beb tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:47:20.994969 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-4414941c-7655-4cec-9eca-bce1a0249beb tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815" status: 200 len: 1271 microversion: 2.1 time: 0.206473 Aug 10 13:47:20.995859 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 508/988] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:47:20 2022] GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815 => generated 1271 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:47:22.009307 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-b3712622-540d-4f14-b227-cb37cda0c5ee tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:22.010893 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-b3712622-540d-4f14-b227-cb37cda0c5ee tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 160c89f2-984e-472a-8963-eeefb63824b1] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:22.021932 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b3712622-540d-4f14-b227-cb37cda0c5ee tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:22.023724 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b3712622-540d-4f14-b227-cb37cda0c5ee tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:22.024769 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b3712622-540d-4f14-b227-cb37cda0c5ee tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:22.026266 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b3712622-540d-4f14-b227-cb37cda0c5ee tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:22.027315 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b3712622-540d-4f14-b227-cb37cda0c5ee tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:22.027557 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-a9c90dc4-5ad6-4cac-a771-f2dc6bd5be59 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:22.028281 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-a9c90dc4-5ad6-4cac-a771-f2dc6bd5be59 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: ab3fe1fe-15d6-45b2-8f3a-48ea930dc815] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:22.029583 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-b3712622-540d-4f14-b227-cb37cda0c5ee tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:22.046684 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a9c90dc4-5ad6-4cac-a771-f2dc6bd5be59 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:22.047879 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a9c90dc4-5ad6-4cac-a771-f2dc6bd5be59 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:22.048739 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a9c90dc4-5ad6-4cac-a771-f2dc6bd5be59 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:22.049738 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a9c90dc4-5ad6-4cac-a771-f2dc6bd5be59 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:22.050432 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a9c90dc4-5ad6-4cac-a771-f2dc6bd5be59 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:22.051141 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-a9c90dc4-5ad6-4cac-a771-f2dc6bd5be59 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:22.156807 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-a9c90dc4-5ad6-4cac-a771-f2dc6bd5be59 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:47:22.167612 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-a9c90dc4-5ad6-4cac-a771-f2dc6bd5be59 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815" status: 200 len: 1271 microversion: 2.1 time: 0.147051 Aug 10 13:47:22.169521 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 509/989] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:47:22 2022] GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815 => generated 1271 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:47:23.122969 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-b3712622-540d-4f14-b227-cb37cda0c5ee tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:47:23.140257 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-b3712622-540d-4f14-b227-cb37cda0c5ee tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1" status: 200 len: 1577 microversion: 2.1 time: 1.134407 Aug 10 13:47:23.154439 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 481/990] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:47:22 2022] GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1 => generated 1577 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:47:23.203807 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-59fda036-e975-4f82-9ecc-1bbf4e9df01d tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:23.205773 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-59fda036-e975-4f82-9ecc-1bbf4e9df01d tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: ab3fe1fe-15d6-45b2-8f3a-48ea930dc815] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:23.226757 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-59fda036-e975-4f82-9ecc-1bbf4e9df01d tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:23.227351 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-59fda036-e975-4f82-9ecc-1bbf4e9df01d tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:23.228647 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-59fda036-e975-4f82-9ecc-1bbf4e9df01d tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:23.229507 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-59fda036-e975-4f82-9ecc-1bbf4e9df01d tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:23.230036 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-59fda036-e975-4f82-9ecc-1bbf4e9df01d tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:23.230535 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-59fda036-e975-4f82-9ecc-1bbf4e9df01d tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:23.238248 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell1:SELECT=81 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:47:23.403967 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-59fda036-e975-4f82-9ecc-1bbf4e9df01d tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:47:23.426678 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-59fda036-e975-4f82-9ecc-1bbf4e9df01d tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815" status: 200 len: 1277 microversion: 2.1 time: 0.236582 Aug 10 13:47:23.432252 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 510/991] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:47:23 2022] GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815 => generated 1277 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:47:24.171370 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-135fbd9c-838e-4e16-946f-ce9f38122630 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:24.172378 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-135fbd9c-838e-4e16-946f-ce9f38122630 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 160c89f2-984e-472a-8963-eeefb63824b1] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:24.204298 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-135fbd9c-838e-4e16-946f-ce9f38122630 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:24.207105 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-135fbd9c-838e-4e16-946f-ce9f38122630 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:24.208527 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-b7f592b1-120b-4582-9d34-677b9b68a181 req-db32b17f-c136-41be-b5fa-0cb5b54bad19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "160c89f2-984e-472a-8963-eeefb63824b1", "name": "network-vif-deleted", "tag": "6cf489ec-5def-460d-a9f9-421d77157738"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:47:24.209139 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-135fbd9c-838e-4e16-946f-ce9f38122630 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:24.212940 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-135fbd9c-838e-4e16-946f-ce9f38122630 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:24.213763 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-135fbd9c-838e-4e16-946f-ce9f38122630 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:24.214420 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-135fbd9c-838e-4e16-946f-ce9f38122630 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:24.229162 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-b7f592b1-120b-4582-9d34-677b9b68a181 req-db32b17f-c136-41be-b5fa-0cb5b54bad19 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:24.229892 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-b7f592b1-120b-4582-9d34-677b9b68a181 req-db32b17f-c136-41be-b5fa-0cb5b54bad19 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:24.230499 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-b7f592b1-120b-4582-9d34-677b9b68a181 req-db32b17f-c136-41be-b5fa-0cb5b54bad19 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:24.309514 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-b7f592b1-120b-4582-9d34-677b9b68a181 req-db32b17f-c136-41be-b5fa-0cb5b54bad19 service nova] Creating event network-vif-deleted:6cf489ec-5def-460d-a9f9-421d77157738 for instance 160c89f2-984e-472a-8963-eeefb63824b1 on hv-cinder-85200 Aug 10 13:47:24.337670 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-b7f592b1-120b-4582-9d34-677b9b68a181 req-db32b17f-c136-41be-b5fa-0cb5b54bad19 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132956 Aug 10 13:47:24.341446 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 511/992] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:47:24.403863 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-135fbd9c-838e-4e16-946f-ce9f38122630 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411ff3f0306848ee91108343982806ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f008781f64d09b706d478c8fe8922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:47:24.416815 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-135fbd9c-838e-4e16-946f-ce9f38122630 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1" status: 200 len: 1392 microversion: 2.1 time: 0.250982 Aug 10 13:47:24.417321 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 482/993] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:47:24 2022] GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1 => generated 1392 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:47:24.465815 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-816fc917-cee3-454b-9d04-bf63435044bd tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:24.466796 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-816fc917-cee3-454b-9d04-bf63435044bd tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: ab3fe1fe-15d6-45b2-8f3a-48ea930dc815] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:24.476450 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-816fc917-cee3-454b-9d04-bf63435044bd tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:24.479668 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-816fc917-cee3-454b-9d04-bf63435044bd tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:24.482130 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-816fc917-cee3-454b-9d04-bf63435044bd tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:24.485127 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-816fc917-cee3-454b-9d04-bf63435044bd tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:24.485944 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-816fc917-cee3-454b-9d04-bf63435044bd tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:24.486460 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-816fc917-cee3-454b-9d04-bf63435044bd tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:24.939563 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-816fc917-cee3-454b-9d04-bf63435044bd tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:47:24.958720 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-816fc917-cee3-454b-9d04-bf63435044bd tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815" status: 200 len: 1319 microversion: 2.1 time: 0.498023 Aug 10 13:47:24.959844 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 512/994] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:47:24 2022] GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815 => generated 1319 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:47:25.389985 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-264e9391-7145-499c-9853-0639e1a47f5c req-14407ddc-94d7-43ea-bd4b-68b7d49cac84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab3fe1fe-15d6-45b2-8f3a-48ea930dc815", "tag": "bd11a29d-bda7-4ec5-aa64-8c7dcbe8cbdf"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:47:25.404209 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell0:SELECT=2 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:47:25.405297 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell0:SELECT=6 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:47:25.413945 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-264e9391-7145-499c-9853-0639e1a47f5c req-14407ddc-94d7-43ea-bd4b-68b7d49cac84 service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:25.417837 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-264e9391-7145-499c-9853-0639e1a47f5c req-14407ddc-94d7-43ea-bd4b-68b7d49cac84 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:25.418490 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-264e9391-7145-499c-9853-0639e1a47f5c req-14407ddc-94d7-43ea-bd4b-68b7d49cac84 service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:25.443993 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-d504e177-da62-426c-866d-f40d2980ce89 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:25.445374 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-d504e177-da62-426c-866d-f40d2980ce89 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 160c89f2-984e-472a-8963-eeefb63824b1] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:25.447460 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell0:SELECT=2 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:47:25.455868 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d504e177-da62-426c-866d-f40d2980ce89 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:25.456366 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d504e177-da62-426c-866d-f40d2980ce89 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:25.456999 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d504e177-da62-426c-866d-f40d2980ce89 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:25.457555 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d504e177-da62-426c-866d-f40d2980ce89 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:25.458036 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d504e177-da62-426c-866d-f40d2980ce89 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:25.458487 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d504e177-da62-426c-866d-f40d2980ce89 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:25.482255 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.wsgi [None req-d504e177-da62-426c-866d-f40d2980ce89 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] HTTP exception thrown: Instance 160c89f2-984e-472a-8963-eeefb63824b1 could not be found. Aug 10 13:47:25.482536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-264e9391-7145-499c-9853-0639e1a47f5c req-14407ddc-94d7-43ea-bd4b-68b7d49cac84 service nova] Creating event network-changed:bd11a29d-bda7-4ec5-aa64-8c7dcbe8cbdf for instance ab3fe1fe-15d6-45b2-8f3a-48ea930dc815 on hv-cinder-85200 Aug 10 13:47:25.484515 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-d504e177-da62-426c-866d-f40d2980ce89 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Request method failure captured: Aug 10 13:47:25.484515 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: request: GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1 HTTP/1.1 Aug 10 13:47:25.484515 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept: application/json Aug 10 13:47:25.484515 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept-Encoding: identity Aug 10 13:47:25.484515 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Connection: close Aug 10 13:47:25.484515 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Length: 0 Aug 10 13:47:25.484515 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Type: application/json Aug 10 13:47:25.484515 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Host: 10.222.0.52 Aug 10 13:47:25.484515 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Openstack-System-Scope: None Aug 10 13:47:25.484515 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: User-Agent: python-urllib3/1.26.11 Aug 10 13:47:25.484515 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Auth-Token: gAAAAABi87TSzxP2-YwwzoVQUCaIGZpUao_F-X-e3X9CWe3aw04cqEa58UtxCos4r-Q3NFdtiQhGTNowwWExRyEAyMlYgP4tsLTK5yzvxfKVpqHSHKFu7wTq3iH51AqunAJMGmD2Ry377K0xwLIwG9QqTwzXWE-7Zp72mPPCiwxzQiXyh6jtvqI Aug 10 13:47:25.484515 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Id: None Aug 10 13:47:25.484515 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Name: None Aug 10 13:47:25.484515 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Identity-Status: Confirmed Aug 10 13:47:25.484515 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Is-Admin-Project: True Aug 10 13:47:25.484515 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Id: default Aug 10 13:47:25.484515 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Name: Default Aug 10 13:47:25.484515 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Id: b52f008781f64d09b706d478c8fe8922 Aug 10 13:47:25.484515 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Name: tempest-TestVolumeBootPattern-1665317784 Aug 10 13:47:25.484515 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Role: member,reader Aug 10 13:47:25.484515 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Roles: member,reader Aug 10 13:47:25.486248 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b52f008781f64d09b706d478c8fe8922"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b52f008781f64d09b706d478c8fe8922"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b52f008781f64d09b706d478c8fe8922", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b52f008781f64d09b706d478c8fe8922"}]}] Aug 10 13:47:25.486248 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant: tempest-TestVolumeBootPattern-1665317784 Aug 10 13:47:25.486248 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Id: b52f008781f64d09b706d478c8fe8922 Aug 10 13:47:25.486248 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Name: tempest-TestVolumeBootPattern-1665317784 Aug 10 13:47:25.486248 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User: tempest-TestVolumeBootPattern-1665317784-project Aug 10 13:47:25.486248 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Id: default Aug 10 13:47:25.486248 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Name: Default Aug 10 13:47:25.486248 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Id: 411ff3f0306848ee91108343982806ca Aug 10 13:47:25.486248 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Name: tempest-TestVolumeBootPattern-1665317784-project Aug 10 13:47:25.486248 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: method: > Aug 10 13:47:25.486248 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: exception: Instance 160c89f2-984e-472a-8963-eeefb63824b1 could not be found. Aug 10 13:47:25.486248 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: action_args: {'id': '160c89f2-984e-472a-8963-eeefb63824b1'} Aug 10 13:47:25.487959 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:47:25.487959 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:47:25.487959 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:47:25.487959 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:47:25.487959 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:47:25.487959 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:47:25.487959 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:47:25.487959 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:47:25.487959 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:47:25.487959 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:47:25.487959 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 160c89f2-984e-472a-8963-eeefb63824b1 could not be found. Aug 10 13:47:25.487959 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:47:25.487959 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:47:25.487959 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:47:25.487959 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:47:25.487959 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:47:25.487959 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:47:25.487959 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:47:25.487959 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:47:25.487959 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:47:25.489509 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:47:25.489509 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:47:25.489509 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:47:25.489509 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:47:25.489509 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:47:25.489509 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:47:25.489509 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:47:25.489509 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 160c89f2-984e-472a-8963-eeefb63824b1 could not be found. Aug 10 13:47:25.489509 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:47:25.489509 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:47:25.489509 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:47:25.489509 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:47:25.489509 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:47:25.489509 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:47:25.489509 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:47:25.489509 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:47:25.489509 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 160c89f2-984e-472a-8963-eeefb63824b1 could not be found. Aug 10 13:47:25.489509 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:47:25.494421 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-d504e177-da62-426c-866d-f40d2980ce89 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Returning 404 to user: Instance 160c89f2-984e-472a-8963-eeefb63824b1 could not be found. {{(pid=129522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:47:25.495555 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-d504e177-da62-426c-866d-f40d2980ce89 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1" status: 404 len: 111 microversion: 2.1 time: 0.055825 Aug 10 13:47:25.496635 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 513/995] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:47:25 2022] GET /compute/v2.1/servers/160c89f2-984e-472a-8963-eeefb63824b1 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 13:47:25.511816 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-264e9391-7145-499c-9853-0639e1a47f5c req-14407ddc-94d7-43ea-bd4b-68b7d49cac84 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125933 Aug 10 13:47:25.512428 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 483/996] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:47:25.982511 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-1b713b69-2668-4572-95e8-241085f57ada tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:25.983424 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-1b713b69-2668-4572-95e8-241085f57ada tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: ab3fe1fe-15d6-45b2-8f3a-48ea930dc815] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:25.991153 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1b713b69-2668-4572-95e8-241085f57ada tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:25.992076 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1b713b69-2668-4572-95e8-241085f57ada tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:25.992679 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1b713b69-2668-4572-95e8-241085f57ada tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:25.993693 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1b713b69-2668-4572-95e8-241085f57ada tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:25.994423 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1b713b69-2668-4572-95e8-241085f57ada tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:25.995364 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-1b713b69-2668-4572-95e8-241085f57ada tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:26.340465 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-1b713b69-2668-4572-95e8-241085f57ada tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:47:26.350952 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-1b713b69-2668-4572-95e8-241085f57ada tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815" status: 200 len: 1319 microversion: 2.1 time: 0.374303 Aug 10 13:47:26.354118 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 514/997] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:47:25 2022] GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815 => generated 1319 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:47:26.526628 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-0689ad63-a6eb-48b9-8ae6-ce3f86893251 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:26.527692 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-0689ad63-a6eb-48b9-8ae6-ce3f86893251 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 16659e37-a119-4243-8211-1179306997a5] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:26.539240 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0689ad63-a6eb-48b9-8ae6-ce3f86893251 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:26.540062 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0689ad63-a6eb-48b9-8ae6-ce3f86893251 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:26.540780 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0689ad63-a6eb-48b9-8ae6-ce3f86893251 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:26.542008 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0689ad63-a6eb-48b9-8ae6-ce3f86893251 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:26.543061 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0689ad63-a6eb-48b9-8ae6-ce3f86893251 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:26.543993 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-0689ad63-a6eb-48b9-8ae6-ce3f86893251 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:26.566032 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.wsgi [None req-0689ad63-a6eb-48b9-8ae6-ce3f86893251 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] HTTP exception thrown: Instance 16659e37-a119-4243-8211-1179306997a5 could not be found. Aug 10 13:47:26.567735 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-0689ad63-a6eb-48b9-8ae6-ce3f86893251 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Request method failure captured: Aug 10 13:47:26.567735 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: request: DELETE /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5 HTTP/1.1 Aug 10 13:47:26.567735 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept: application/json Aug 10 13:47:26.567735 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept-Encoding: identity Aug 10 13:47:26.567735 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Connection: close Aug 10 13:47:26.567735 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Length: 0 Aug 10 13:47:26.567735 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Type: application/json Aug 10 13:47:26.567735 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Host: 10.222.0.52 Aug 10 13:47:26.567735 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Openstack-System-Scope: None Aug 10 13:47:26.567735 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: User-Agent: python-urllib3/1.26.11 Aug 10 13:47:26.567735 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Auth-Token: gAAAAABi87TSzxP2-YwwzoVQUCaIGZpUao_F-X-e3X9CWe3aw04cqEa58UtxCos4r-Q3NFdtiQhGTNowwWExRyEAyMlYgP4tsLTK5yzvxfKVpqHSHKFu7wTq3iH51AqunAJMGmD2Ry377K0xwLIwG9QqTwzXWE-7Zp72mPPCiwxzQiXyh6jtvqI Aug 10 13:47:26.567735 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Id: None Aug 10 13:47:26.567735 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Name: None Aug 10 13:47:26.567735 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Identity-Status: Confirmed Aug 10 13:47:26.567735 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Is-Admin-Project: True Aug 10 13:47:26.567735 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Id: default Aug 10 13:47:26.567735 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Name: Default Aug 10 13:47:26.567735 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Id: b52f008781f64d09b706d478c8fe8922 Aug 10 13:47:26.567735 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Name: tempest-TestVolumeBootPattern-1665317784 Aug 10 13:47:26.567735 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Role: member,reader Aug 10 13:47:26.567735 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Roles: member,reader Aug 10 13:47:26.569204 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b52f008781f64d09b706d478c8fe8922"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b52f008781f64d09b706d478c8fe8922"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b52f008781f64d09b706d478c8fe8922", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b52f008781f64d09b706d478c8fe8922"}]}] Aug 10 13:47:26.569204 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant: tempest-TestVolumeBootPattern-1665317784 Aug 10 13:47:26.569204 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Id: b52f008781f64d09b706d478c8fe8922 Aug 10 13:47:26.569204 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Name: tempest-TestVolumeBootPattern-1665317784 Aug 10 13:47:26.569204 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User: tempest-TestVolumeBootPattern-1665317784-project Aug 10 13:47:26.569204 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Id: default Aug 10 13:47:26.569204 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Name: Default Aug 10 13:47:26.569204 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Id: 411ff3f0306848ee91108343982806ca Aug 10 13:47:26.569204 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Name: tempest-TestVolumeBootPattern-1665317784-project Aug 10 13:47:26.569204 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: method: > Aug 10 13:47:26.569204 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: exception: Instance 16659e37-a119-4243-8211-1179306997a5 could not be found. Aug 10 13:47:26.569204 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: action_args: {'id': '16659e37-a119-4243-8211-1179306997a5'} Aug 10 13:47:26.570810 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:47:26.570810 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:47:26.570810 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:47:26.570810 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:47:26.570810 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:47:26.570810 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:47:26.570810 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:47:26.570810 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:47:26.570810 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:47:26.570810 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:47:26.570810 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16659e37-a119-4243-8211-1179306997a5 could not be found. Aug 10 13:47:26.570810 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:47:26.570810 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:47:26.570810 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:47:26.570810 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:47:26.570810 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:47:26.570810 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:47:26.570810 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:47:26.570810 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:47:26.570810 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:47:26.572376 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:47:26.572376 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 13:47:26.572376 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 13:47:26.572376 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 13:47:26.572376 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 13:47:26.572376 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:47:26.572376 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:47:26.572376 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:47:26.572376 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:47:26.572376 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16659e37-a119-4243-8211-1179306997a5 could not be found. Aug 10 13:47:26.572376 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:47:26.572376 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:47:26.572376 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:47:26.572376 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:47:26.572376 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:47:26.572376 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:47:26.572376 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:47:26.572376 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:47:26.572376 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16659e37-a119-4243-8211-1179306997a5 could not be found. Aug 10 13:47:26.572376 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:47:26.575223 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-0689ad63-a6eb-48b9-8ae6-ce3f86893251 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Returning 404 to user: Instance 16659e37-a119-4243-8211-1179306997a5 could not be found. {{(pid=129523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:47:26.576287 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-0689ad63-a6eb-48b9-8ae6-ce3f86893251 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "DELETE /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5" status: 404 len: 111 microversion: 2.1 time: 0.061784 Aug 10 13:47:26.577030 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 484/998] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 10 13:47:26 2022] DELETE /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:47:26.585903 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-5ca8b0aa-9ad8-4334-84ed-ed444cf982cd tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:26.587170 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-5ca8b0aa-9ad8-4334-84ed-ed444cf982cd tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [instance: 16659e37-a119-4243-8211-1179306997a5] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:26.603265 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5ca8b0aa-9ad8-4334-84ed-ed444cf982cd tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:26.605441 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5ca8b0aa-9ad8-4334-84ed-ed444cf982cd tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:26.605902 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5ca8b0aa-9ad8-4334-84ed-ed444cf982cd tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:26.606628 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5ca8b0aa-9ad8-4334-84ed-ed444cf982cd tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:26.607411 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5ca8b0aa-9ad8-4334-84ed-ed444cf982cd tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:26.608061 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-5ca8b0aa-9ad8-4334-84ed-ed444cf982cd tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:26.626988 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.wsgi [None req-5ca8b0aa-9ad8-4334-84ed-ed444cf982cd tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] HTTP exception thrown: Instance 16659e37-a119-4243-8211-1179306997a5 could not be found. Aug 10 13:47:26.630376 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-5ca8b0aa-9ad8-4334-84ed-ed444cf982cd tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Request method failure captured: Aug 10 13:47:26.630376 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: request: GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5 HTTP/1.1 Aug 10 13:47:26.630376 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept: application/json Aug 10 13:47:26.630376 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept-Encoding: identity Aug 10 13:47:26.630376 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Connection: close Aug 10 13:47:26.630376 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Length: 0 Aug 10 13:47:26.630376 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Type: application/json Aug 10 13:47:26.630376 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Host: 10.222.0.52 Aug 10 13:47:26.630376 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Openstack-System-Scope: None Aug 10 13:47:26.630376 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: User-Agent: python-urllib3/1.26.11 Aug 10 13:47:26.630376 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Auth-Token: gAAAAABi87TSzxP2-YwwzoVQUCaIGZpUao_F-X-e3X9CWe3aw04cqEa58UtxCos4r-Q3NFdtiQhGTNowwWExRyEAyMlYgP4tsLTK5yzvxfKVpqHSHKFu7wTq3iH51AqunAJMGmD2Ry377K0xwLIwG9QqTwzXWE-7Zp72mPPCiwxzQiXyh6jtvqI Aug 10 13:47:26.630376 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Id: None Aug 10 13:47:26.630376 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Name: None Aug 10 13:47:26.630376 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Identity-Status: Confirmed Aug 10 13:47:26.630376 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Is-Admin-Project: True Aug 10 13:47:26.630376 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Id: default Aug 10 13:47:26.630376 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Name: Default Aug 10 13:47:26.630376 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Id: b52f008781f64d09b706d478c8fe8922 Aug 10 13:47:26.630376 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Name: tempest-TestVolumeBootPattern-1665317784 Aug 10 13:47:26.630376 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Role: member,reader Aug 10 13:47:26.630376 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Roles: member,reader Aug 10 13:47:26.632832 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b52f008781f64d09b706d478c8fe8922"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b52f008781f64d09b706d478c8fe8922"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b52f008781f64d09b706d478c8fe8922", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b52f008781f64d09b706d478c8fe8922"}]}] Aug 10 13:47:26.632832 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant: tempest-TestVolumeBootPattern-1665317784 Aug 10 13:47:26.632832 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Id: b52f008781f64d09b706d478c8fe8922 Aug 10 13:47:26.632832 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Name: tempest-TestVolumeBootPattern-1665317784 Aug 10 13:47:26.632832 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User: tempest-TestVolumeBootPattern-1665317784-project Aug 10 13:47:26.632832 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Id: default Aug 10 13:47:26.632832 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Name: Default Aug 10 13:47:26.632832 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Id: 411ff3f0306848ee91108343982806ca Aug 10 13:47:26.632832 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Name: tempest-TestVolumeBootPattern-1665317784-project Aug 10 13:47:26.632832 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: method: > Aug 10 13:47:26.632832 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: exception: Instance 16659e37-a119-4243-8211-1179306997a5 could not be found. Aug 10 13:47:26.632832 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: action_args: {'id': '16659e37-a119-4243-8211-1179306997a5'} Aug 10 13:47:26.634378 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:47:26.634378 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:47:26.634378 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:47:26.634378 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:47:26.634378 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:47:26.634378 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:47:26.634378 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:47:26.634378 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:47:26.634378 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:47:26.634378 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:47:26.634378 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16659e37-a119-4243-8211-1179306997a5 could not be found. Aug 10 13:47:26.634378 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:47:26.634378 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:47:26.634378 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:47:26.634378 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:47:26.634378 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:47:26.634378 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:47:26.634378 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:47:26.634378 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:47:26.634378 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:47:26.635996 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:47:26.635996 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:47:26.635996 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:47:26.635996 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:47:26.635996 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:47:26.635996 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:47:26.635996 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:47:26.635996 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16659e37-a119-4243-8211-1179306997a5 could not be found. Aug 10 13:47:26.635996 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:47:26.635996 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:47:26.635996 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:47:26.635996 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:47:26.635996 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:47:26.635996 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:47:26.635996 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:47:26.635996 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:47:26.635996 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16659e37-a119-4243-8211-1179306997a5 could not be found. Aug 10 13:47:26.635996 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:47:26.637670 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-5ca8b0aa-9ad8-4334-84ed-ed444cf982cd tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Returning 404 to user: Instance 16659e37-a119-4243-8211-1179306997a5 could not be found. {{(pid=129522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:47:26.637670 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-5ca8b0aa-9ad8-4334-84ed-ed444cf982cd tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5" status: 404 len: 111 microversion: 2.1 time: 0.050359 Aug 10 13:47:26.639012 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 515/999] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:47:26 2022] GET /compute/v2.1/servers/16659e37-a119-4243-8211-1179306997a5 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 13:47:27.393274 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-478285d8-f40d-44b2-a76e-a4046d78c82d tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:27.394971 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-478285d8-f40d-44b2-a76e-a4046d78c82d tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: ab3fe1fe-15d6-45b2-8f3a-48ea930dc815] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:27.405178 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-478285d8-f40d-44b2-a76e-a4046d78c82d tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:27.406595 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-478285d8-f40d-44b2-a76e-a4046d78c82d tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:27.407257 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-478285d8-f40d-44b2-a76e-a4046d78c82d tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:27.408257 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-478285d8-f40d-44b2-a76e-a4046d78c82d tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:27.409247 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-478285d8-f40d-44b2-a76e-a4046d78c82d tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:27.410070 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-478285d8-f40d-44b2-a76e-a4046d78c82d tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:27.653034 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-478285d8-f40d-44b2-a76e-a4046d78c82d tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:47:27.681692 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-478285d8-f40d-44b2-a76e-a4046d78c82d tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815" status: 200 len: 1319 microversion: 2.1 time: 0.302353 Aug 10 13:47:27.683614 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 485/1000] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:47:27 2022] GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815 => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:47:28.136225 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-1cbb4e9b-905a-4dd9-8d13-ea104b4303b8 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] Calling method '.version_select at 0x7f49c468f8b0>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:28.141105 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1cbb4e9b-905a-4dd9-8d13-ea104b4303b8 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [da680217-c59b-4b20-8aca-53b1cb99f9ae] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 13:47:28.707863 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-31890f8f-0379-47d5-89f7-2025372a1bcc tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:28.709770 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-31890f8f-0379-47d5-89f7-2025372a1bcc tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: ab3fe1fe-15d6-45b2-8f3a-48ea930dc815] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:28.720010 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-31890f8f-0379-47d5-89f7-2025372a1bcc tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:28.721738 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-31890f8f-0379-47d5-89f7-2025372a1bcc tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:28.722181 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-31890f8f-0379-47d5-89f7-2025372a1bcc tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:28.722911 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-31890f8f-0379-47d5-89f7-2025372a1bcc tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:28.723609 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-31890f8f-0379-47d5-89f7-2025372a1bcc tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:28.724218 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-31890f8f-0379-47d5-89f7-2025372a1bcc tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:29.158288 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO oslo.messaging._drivers.impl_rabbit [None req-1cbb4e9b-905a-4dd9-8d13-ea104b4303b8 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] [da680217-c59b-4b20-8aca-53b1cb99f9ae] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 36830. Aug 10 13:47:29.223262 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-1cbb4e9b-905a-4dd9-8d13-ea104b4303b8 tempest-TestVolumeBootPattern-1665317784 tempest-TestVolumeBootPattern-1665317784-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1990044180" status: 202 len: 0 microversion: 2.1 time: 1.091460 Aug 10 13:47:29.224470 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 516/1001] 10.222.0.52 () {58 vars in 1263 bytes} [Wed Aug 10 13:47:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1990044180 => generated 0 bytes in 1094 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:47:29.407650 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-31890f8f-0379-47d5-89f7-2025372a1bcc tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:47:29.452633 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-31890f8f-0379-47d5-89f7-2025372a1bcc tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815" status: 200 len: 1319 microversion: 2.1 time: 0.749958 Aug 10 13:47:29.455890 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 486/1002] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:47:28 2022] GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815 => generated 1319 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:47:30.497579 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-09a1cfd7-4114-45c5-9495-98e1207a5b53 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:30.511317 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-09a1cfd7-4114-45c5-9495-98e1207a5b53 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: ab3fe1fe-15d6-45b2-8f3a-48ea930dc815] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:30.546921 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-09a1cfd7-4114-45c5-9495-98e1207a5b53 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:30.547883 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-09a1cfd7-4114-45c5-9495-98e1207a5b53 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:30.550325 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-09a1cfd7-4114-45c5-9495-98e1207a5b53 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:30.551707 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-09a1cfd7-4114-45c5-9495-98e1207a5b53 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:30.552743 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-09a1cfd7-4114-45c5-9495-98e1207a5b53 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:30.553490 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-09a1cfd7-4114-45c5-9495-98e1207a5b53 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:30.984694 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-09a1cfd7-4114-45c5-9495-98e1207a5b53 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:47:31.008768 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-09a1cfd7-4114-45c5-9495-98e1207a5b53 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815" status: 200 len: 1319 microversion: 2.1 time: 0.514793 Aug 10 13:47:31.037261 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 517/1003] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:47:30 2022] GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815 => generated 1319 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:47:32.044726 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-7c05adf5-c0cf-4842-95db-602550418c30 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:32.045724 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-7c05adf5-c0cf-4842-95db-602550418c30 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: ab3fe1fe-15d6-45b2-8f3a-48ea930dc815] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:32.062138 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7c05adf5-c0cf-4842-95db-602550418c30 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:32.062745 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7c05adf5-c0cf-4842-95db-602550418c30 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:32.063201 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7c05adf5-c0cf-4842-95db-602550418c30 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:32.063957 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7c05adf5-c0cf-4842-95db-602550418c30 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:32.064417 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7c05adf5-c0cf-4842-95db-602550418c30 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:32.066568 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7c05adf5-c0cf-4842-95db-602550418c30 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:32.158084 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-183bba28-ff89-420c-8be7-11e53b030172 req-55450d66-0b5e-45d4-a984-94e7721333bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab3fe1fe-15d6-45b2-8f3a-48ea930dc815", "name": "network-vif-plugged", "status": "completed", "tag": "bd11a29d-bda7-4ec5-aa64-8c7dcbe8cbdf"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:47:32.220189 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-183bba28-ff89-420c-8be7-11e53b030172 req-55450d66-0b5e-45d4-a984-94e7721333bf service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:32.220586 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-183bba28-ff89-420c-8be7-11e53b030172 req-55450d66-0b5e-45d4-a984-94e7721333bf service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:32.221014 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-183bba28-ff89-420c-8be7-11e53b030172 req-55450d66-0b5e-45d4-a984-94e7721333bf service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:32.244617 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-183bba28-ff89-420c-8be7-11e53b030172 req-55450d66-0b5e-45d4-a984-94e7721333bf service nova] Creating event network-vif-plugged:bd11a29d-bda7-4ec5-aa64-8c7dcbe8cbdf for instance ab3fe1fe-15d6-45b2-8f3a-48ea930dc815 on hv-cinder-85200 Aug 10 13:47:32.266306 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-183bba28-ff89-420c-8be7-11e53b030172 req-55450d66-0b5e-45d4-a984-94e7721333bf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114513 Aug 10 13:47:32.266956 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 518/1004] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:47:32.436556 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-7c05adf5-c0cf-4842-95db-602550418c30 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:47:32.451562 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-7c05adf5-c0cf-4842-95db-602550418c30 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815" status: 200 len: 1319 microversion: 2.1 time: 0.410350 Aug 10 13:47:32.452627 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 487/1005] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:47:32 2022] GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815 => generated 1319 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:47:33.473339 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-2aee56de-3944-4ea6-ae60-b3f189cac448 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:33.474803 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-2aee56de-3944-4ea6-ae60-b3f189cac448 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: ab3fe1fe-15d6-45b2-8f3a-48ea930dc815] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:33.484722 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2aee56de-3944-4ea6-ae60-b3f189cac448 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:33.485219 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2aee56de-3944-4ea6-ae60-b3f189cac448 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:33.485830 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2aee56de-3944-4ea6-ae60-b3f189cac448 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:33.486638 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2aee56de-3944-4ea6-ae60-b3f189cac448 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:33.487457 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2aee56de-3944-4ea6-ae60-b3f189cac448 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:33.488306 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2aee56de-3944-4ea6-ae60-b3f189cac448 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:33.895381 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-e56583f9-47f5-4067-8a00-729a2ca47623 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Action: 'create', calling method: .version_select at 0x7f49c461ad30>, body: {"keypair": {"name": "tempest-TestShelveInstance-581234170", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjqj0Xko92wca8vZJM0Dk5HsEIyvF3ROuAaupLIV/u2HFwjyZZ1Qla2o2VUQaGa/19QuWeL1YIlHzbCdWq8YNm7D+pjwkSuf9tMxR6roTBWSlNsmx83Axv4EKHOA6ighw=="}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:47:33.927339 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-e56583f9-47f5-4067-8a00-729a2ca47623 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Getting quotas for project 15d732726c004517ad7e771af3f3b805. Resources: {'key_pairs'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:47:33.934704 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-e56583f9-47f5-4067-8a00-729a2ca47623 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Getting quotas for user 0a7f0324eba3466aa985febfaf47b990 and project 15d732726c004517ad7e771af3f3b805. Resources: {'key_pairs'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:47:33.960431 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e56583f9-47f5-4067-8a00-729a2ca47623 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [731ce2f3-65ed-49a5-a149-44c3778e6c51] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 13:47:34.065065 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-2aee56de-3944-4ea6-ae60-b3f189cac448 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:47:34.075022 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-2aee56de-3944-4ea6-ae60-b3f189cac448 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815" status: 200 len: 1319 microversion: 2.1 time: 0.606405 Aug 10 13:47:34.075536 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 519/1006] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:47:33 2022] GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815 => generated 1319 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:47:34.972811 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO oslo.messaging._drivers.impl_rabbit [None req-e56583f9-47f5-4067-8a00-729a2ca47623 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [731ce2f3-65ed-49a5-a149-44c3778e6c51] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 36862. Aug 10 13:47:34.993578 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-e56583f9-47f5-4067-8a00-729a2ca47623 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 1.505390 Aug 10 13:47:35.001105 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 488/1007] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Aug 10 13:47:33 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:47:35.097684 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-56f83a2e-dd8f-4702-915d-e95a3b036aaa tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:35.098937 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-56f83a2e-dd8f-4702-915d-e95a3b036aaa tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: ab3fe1fe-15d6-45b2-8f3a-48ea930dc815] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:35.107751 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-56f83a2e-dd8f-4702-915d-e95a3b036aaa tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:35.108501 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-56f83a2e-dd8f-4702-915d-e95a3b036aaa tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:35.109167 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-56f83a2e-dd8f-4702-915d-e95a3b036aaa tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:35.110332 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-56f83a2e-dd8f-4702-915d-e95a3b036aaa tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:35.111138 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-56f83a2e-dd8f-4702-915d-e95a3b036aaa tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:35.111654 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-56f83a2e-dd8f-4702-915d-e95a3b036aaa tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:35.288899 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-56f83a2e-dd8f-4702-915d-e95a3b036aaa tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:47:35.299225 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-56f83a2e-dd8f-4702-915d-e95a3b036aaa tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815" status: 200 len: 1508 microversion: 2.1 time: 0.207083 Aug 10 13:47:35.299929 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 520/1008] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:47:35 2022] GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815 => generated 1508 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:47:35.324584 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-faeeec88-9db4-47b3-b02a-ba69c323f9fc tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "13f47af6-2c24-4d17-ad8d-f64e0ba8cc2d", "device": "/dev/sdb"}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:47:35.329680 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-faeeec88-9db4-47b3-b02a-ba69c323f9fc tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: ab3fe1fe-15d6-45b2-8f3a-48ea930dc815] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:35.338958 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-faeeec88-9db4-47b3-b02a-ba69c323f9fc tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:35.339560 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-faeeec88-9db4-47b3-b02a-ba69c323f9fc tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:35.340074 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-faeeec88-9db4-47b3-b02a-ba69c323f9fc tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:35.340891 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-faeeec88-9db4-47b3-b02a-ba69c323f9fc tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:35.341386 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-faeeec88-9db4-47b3-b02a-ba69c323f9fc tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:35.342013 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-faeeec88-9db4-47b3-b02a-ba69c323f9fc tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:35.795060 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-faeeec88-9db4-47b3-b02a-ba69c323f9fc tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "POST /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.478126 Aug 10 13:47:35.795795 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 489/1009] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 10 13:47:35 2022] POST /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815/os-volume_attachments => generated 194 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:47:54.440434 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-2b2b219c-1180-4d6e-8f2d-cf1479a07445 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:54.441020 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-2b2b219c-1180-4d6e-8f2d-cf1479a07445 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: ab3fe1fe-15d6-45b2-8f3a-48ea930dc815] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:54.443693 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:47:54.444362 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell1:SELECT=43 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:47:54.451204 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2b2b219c-1180-4d6e-8f2d-cf1479a07445 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:54.451751 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2b2b219c-1180-4d6e-8f2d-cf1479a07445 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:54.452484 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2b2b219c-1180-4d6e-8f2d-cf1479a07445 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:54.453603 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2b2b219c-1180-4d6e-8f2d-cf1479a07445 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:54.454700 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2b2b219c-1180-4d6e-8f2d-cf1479a07445 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:54.455133 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-2b2b219c-1180-4d6e-8f2d-cf1479a07445 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:54.536215 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.objects.instance [None req-2b2b219c-1180-4d6e-8f2d-cf1479a07445 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lazy-loading 'services' on Instance uuid ab3fe1fe-15d6-45b2-8f3a-48ea930dc815 {{(pid=129522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:47:54.608702 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-2b2b219c-1180-4d6e-8f2d-cf1479a07445 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815/os-volume_attachments/13f47af6-2c24-4d17-ad8d-f64e0ba8cc2d" status: 202 len: 0 microversion: 2.1 time: 0.171985 Aug 10 13:47:54.609499 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 521/1010] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Aug 10 13:47:54 2022] DELETE /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815/os-volume_attachments/13f47af6-2c24-4d17-ad8d-f64e0ba8cc2d => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:47:55.025979 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell0:SELECT=4 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:47:55.026729 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:47:55.027700 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:47:55.032530 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-178ba133-16b0-4fa0-8523-442d479f82ba tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1240489409", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-581234170", "security_groups": [{"name": "tempest-secgroup-smoke-762808240"}], "networks": [{"uuid": "a95e8227-5ba9-42ed-8fb2-7f4ce16a0c81"}], "block_device_mapping_v2": [{"uuid": "0745f193-b44d-40b6-b93f-8b92a93eba69", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:47:55.157185 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.network.neutron [None req-178ba133-16b0-4fa0-8523-442d479f82ba tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] validate_networks() for [('a95e8227-5ba9-42ed-8fb2-7f4ce16a0c81', None, None, None, None, None)] {{(pid=129523) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:47:55.558818 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-178ba133-16b0-4fa0-8523-442d479f82ba tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Flavor limits 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:47:55.559339 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-178ba133-16b0-4fa0-8523-442d479f82ba tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Image limits 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:47:55.559808 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-178ba133-16b0-4fa0-8523-442d479f82ba tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Flavor pref 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:47:55.560219 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-178ba133-16b0-4fa0-8523-442d479f82ba tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Image pref 0:0:0 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:47:55.560629 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.virt.hardware [None req-178ba133-16b0-4fa0-8523-442d479f82ba tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:47:55.570635 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-178ba133-16b0-4fa0-8523-442d479f82ba tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:55.571119 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-178ba133-16b0-4fa0-8523-442d479f82ba tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:55.571547 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-178ba133-16b0-4fa0-8523-442d479f82ba tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:55.572264 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-178ba133-16b0-4fa0-8523-442d479f82ba tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:55.572711 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-178ba133-16b0-4fa0-8523-442d479f82ba tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:55.573127 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-178ba133-16b0-4fa0-8523-442d479f82ba tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:55.589542 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-178ba133-16b0-4fa0-8523-442d479f82ba tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Getting quotas for project 15d732726c004517ad7e771af3f3b805. Resources: {'cores', 'ram', 'instances'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:47:55.593720 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.quota [None req-178ba133-16b0-4fa0-8523-442d479f82ba tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Getting quotas for user 0a7f0324eba3466aa985febfaf47b990 and project 15d732726c004517ad7e771af3f3b805. Resources: {'cores', 'ram', 'instances'} {{(pid=129523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:47:55.651163 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-178ba133-16b0-4fa0-8523-442d479f82ba tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Going to run 1 instances... {{(pid=129523) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:47:55.653360 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-178ba133-16b0-4fa0-8523-442d479f82ba tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0745f193-b44d-40b6-b93f-8b92a93eba69',volume_size=None,volume_type=None)] {{(pid=129523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:47:55.786489 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-178ba133-16b0-4fa0-8523-442d479f82ba tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.761866 Aug 10 13:47:55.787151 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 490/1011] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 10 13:47:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 13:47:55.799825 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-096d7bbc-070b-4a5f-ad2e-46beed0ae944 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:55.800523 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-096d7bbc-070b-4a5f-ad2e-46beed0ae944 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:55.857896 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-096d7bbc-070b-4a5f-ad2e-46beed0ae944 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:47:55.865302 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-096d7bbc-070b-4a5f-ad2e-46beed0ae944 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1088 microversion: 2.1 time: 0.070122 Aug 10 13:47:55.871178 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 522/1012] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:47:55 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1088 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:47:55.910261 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-ce62f5bd-e4ff-49fb-97be-61d38074eb29 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:55.910752 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-ce62f5bd-e4ff-49fb-97be-61d38074eb29 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: ab3fe1fe-15d6-45b2-8f3a-48ea930dc815] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:55.923687 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ce62f5bd-e4ff-49fb-97be-61d38074eb29 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:55.924766 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ce62f5bd-e4ff-49fb-97be-61d38074eb29 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:55.925610 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ce62f5bd-e4ff-49fb-97be-61d38074eb29 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:55.926626 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ce62f5bd-e4ff-49fb-97be-61d38074eb29 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:55.927103 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ce62f5bd-e4ff-49fb-97be-61d38074eb29 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:55.927540 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ce62f5bd-e4ff-49fb-97be-61d38074eb29 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:55.953884 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-ce62f5bd-e4ff-49fb-97be-61d38074eb29 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: ab3fe1fe-15d6-45b2-8f3a-48ea930dc815] Going to try to terminate instance {{(pid=129523) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:47:56.034052 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-ce62f5bd-e4ff-49fb-97be-61d38074eb29 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815" status: 204 len: 0 microversion: 2.1 time: 0.127012 Aug 10 13:47:56.038405 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 491/1013] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 10 13:47:55 2022] DELETE /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:47:56.043597 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-b22d5c3b-bf46-4461-835b-f1bb0dc802f8 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:56.044214 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-b22d5c3b-bf46-4461-835b-f1bb0dc802f8 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: ab3fe1fe-15d6-45b2-8f3a-48ea930dc815] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:56.051812 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b22d5c3b-bf46-4461-835b-f1bb0dc802f8 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:56.052304 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b22d5c3b-bf46-4461-835b-f1bb0dc802f8 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:56.052744 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b22d5c3b-bf46-4461-835b-f1bb0dc802f8 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:56.054068 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b22d5c3b-bf46-4461-835b-f1bb0dc802f8 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:56.054522 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b22d5c3b-bf46-4461-835b-f1bb0dc802f8 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:56.054947 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b22d5c3b-bf46-4461-835b-f1bb0dc802f8 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:56.193989 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-b22d5c3b-bf46-4461-835b-f1bb0dc802f8 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:47:56.201676 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-b22d5c3b-bf46-4461-835b-f1bb0dc802f8 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815" status: 200 len: 1514 microversion: 2.1 time: 0.161868 Aug 10 13:47:56.202258 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 523/1014] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:47:56 2022] GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:47:56.887299 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-02983f0b-8330-46cf-b186-eab41e7eced0 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:56.888003 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-02983f0b-8330-46cf-b186-eab41e7eced0 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:56.894334 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-02983f0b-8330-46cf-b186-eab41e7eced0 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:56.894818 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-02983f0b-8330-46cf-b186-eab41e7eced0 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:56.895247 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-02983f0b-8330-46cf-b186-eab41e7eced0 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:56.895930 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-02983f0b-8330-46cf-b186-eab41e7eced0 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:56.896382 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-02983f0b-8330-46cf-b186-eab41e7eced0 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:56.896835 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-02983f0b-8330-46cf-b186-eab41e7eced0 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:56.959098 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-02983f0b-8330-46cf-b186-eab41e7eced0 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:47:56.967137 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-02983f0b-8330-46cf-b186-eab41e7eced0 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1138 microversion: 2.1 time: 0.084027 Aug 10 13:47:56.967704 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 492/1015] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:47:56 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1138 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:47:57.223365 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-8de589d2-2f15-41e2-a50a-fe0c48868419 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:57.223918 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-8de589d2-2f15-41e2-a50a-fe0c48868419 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: ab3fe1fe-15d6-45b2-8f3a-48ea930dc815] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:57.231033 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8de589d2-2f15-41e2-a50a-fe0c48868419 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:57.231520 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8de589d2-2f15-41e2-a50a-fe0c48868419 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:57.231991 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8de589d2-2f15-41e2-a50a-fe0c48868419 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:57.232737 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8de589d2-2f15-41e2-a50a-fe0c48868419 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:57.233195 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8de589d2-2f15-41e2-a50a-fe0c48868419 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:57.233646 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-8de589d2-2f15-41e2-a50a-fe0c48868419 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:57.367806 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-8de589d2-2f15-41e2-a50a-fe0c48868419 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:47:57.376308 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-8de589d2-2f15-41e2-a50a-fe0c48868419 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815" status: 200 len: 1514 microversion: 2.1 time: 0.156814 Aug 10 13:47:57.376918 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 524/1016] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:47:57 2022] GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:47:57.989038 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-e8b61ad0-3e7a-4711-b195-d6c7363ce453 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:57.990059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-e8b61ad0-3e7a-4711-b195-d6c7363ce453 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:58.001465 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e8b61ad0-3e7a-4711-b195-d6c7363ce453 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:58.001750 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e8b61ad0-3e7a-4711-b195-d6c7363ce453 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:58.002785 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e8b61ad0-3e7a-4711-b195-d6c7363ce453 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:58.003762 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e8b61ad0-3e7a-4711-b195-d6c7363ce453 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:58.004681 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e8b61ad0-3e7a-4711-b195-d6c7363ce453 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:58.013211 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e8b61ad0-3e7a-4711-b195-d6c7363ce453 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:58.128907 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-e8b61ad0-3e7a-4711-b195-d6c7363ce453 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:47:58.142628 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-e8b61ad0-3e7a-4711-b195-d6c7363ce453 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1194 microversion: 2.1 time: 0.158102 Aug 10 13:47:58.144032 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 493/1017] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:47:57 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1194 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:47:58.398362 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-3e270ddf-f6ac-4ee4-a4b7-4f38c184ca98 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:58.399848 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-3e270ddf-f6ac-4ee4-a4b7-4f38c184ca98 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: ab3fe1fe-15d6-45b2-8f3a-48ea930dc815] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:58.408412 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3e270ddf-f6ac-4ee4-a4b7-4f38c184ca98 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:58.409013 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3e270ddf-f6ac-4ee4-a4b7-4f38c184ca98 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:58.409806 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3e270ddf-f6ac-4ee4-a4b7-4f38c184ca98 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:58.410726 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3e270ddf-f6ac-4ee4-a4b7-4f38c184ca98 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:58.411513 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3e270ddf-f6ac-4ee4-a4b7-4f38c184ca98 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:58.411949 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3e270ddf-f6ac-4ee4-a4b7-4f38c184ca98 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:58.646335 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-3e270ddf-f6ac-4ee4-a4b7-4f38c184ca98 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968c56b8be242918903711961b6d5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf531c40d3f74fa6aaf3d26794dca09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:47:58.659487 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-3e270ddf-f6ac-4ee4-a4b7-4f38c184ca98 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815" status: 200 len: 1514 microversion: 2.1 time: 0.264897 Aug 10 13:47:58.673286 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 525/1018] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:47:58 2022] GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815 => generated 1514 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:47:58.758323 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-d0eb0e4e-b364-4e33-a5ee-bd9c4af5f809 req-a54f7085-c9c3-4fff-9087-31d7da96503b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab3fe1fe-15d6-45b2-8f3a-48ea930dc815", "name": "network-vif-deleted", "tag": "bd11a29d-bda7-4ec5-aa64-8c7dcbe8cbdf"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:47:58.772779 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-d0eb0e4e-b364-4e33-a5ee-bd9c4af5f809 req-a54f7085-c9c3-4fff-9087-31d7da96503b service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:58.773300 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-d0eb0e4e-b364-4e33-a5ee-bd9c4af5f809 req-a54f7085-c9c3-4fff-9087-31d7da96503b service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:58.773735 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-d0eb0e4e-b364-4e33-a5ee-bd9c4af5f809 req-a54f7085-c9c3-4fff-9087-31d7da96503b service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:58.784905 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-d0eb0e4e-b364-4e33-a5ee-bd9c4af5f809 req-a54f7085-c9c3-4fff-9087-31d7da96503b service nova] Creating event network-vif-deleted:bd11a29d-bda7-4ec5-aa64-8c7dcbe8cbdf for instance ab3fe1fe-15d6-45b2-8f3a-48ea930dc815 on hv-cinder-85200 Aug 10 13:47:58.790420 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-d0eb0e4e-b364-4e33-a5ee-bd9c4af5f809 req-a54f7085-c9c3-4fff-9087-31d7da96503b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036471 Aug 10 13:47:58.791135 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 494/1019] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:47:59.165192 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-0de90e9f-de09-4765-811e-70e4da39727f tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:59.165990 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-0de90e9f-de09-4765-811e-70e4da39727f tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:59.173830 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0de90e9f-de09-4765-811e-70e4da39727f tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:59.174389 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0de90e9f-de09-4765-811e-70e4da39727f tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:59.174808 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0de90e9f-de09-4765-811e-70e4da39727f tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:59.175695 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0de90e9f-de09-4765-811e-70e4da39727f tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:59.176408 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0de90e9f-de09-4765-811e-70e4da39727f tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:59.177048 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0de90e9f-de09-4765-811e-70e4da39727f tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:59.322898 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-0de90e9f-de09-4765-811e-70e4da39727f tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:47:59.331009 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-0de90e9f-de09-4765-811e-70e4da39727f tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1259 microversion: 2.1 time: 0.170441 Aug 10 13:47:59.332174 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 526/1020] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:47:59 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:47:59.686548 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-10233918-9c27-40cf-85b9-8178c5199fb5 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:47:59.687340 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-10233918-9c27-40cf-85b9-8178c5199fb5 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] [instance: ab3fe1fe-15d6-45b2-8f3a-48ea930dc815] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:47:59.694312 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-10233918-9c27-40cf-85b9-8178c5199fb5 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:59.694798 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-10233918-9c27-40cf-85b9-8178c5199fb5 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:59.695225 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-10233918-9c27-40cf-85b9-8178c5199fb5 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:59.695924 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-10233918-9c27-40cf-85b9-8178c5199fb5 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:59.696372 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-10233918-9c27-40cf-85b9-8178c5199fb5 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:59.696788 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-10233918-9c27-40cf-85b9-8178c5199fb5 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:59.711104 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.wsgi [None req-10233918-9c27-40cf-85b9-8178c5199fb5 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] HTTP exception thrown: Instance ab3fe1fe-15d6-45b2-8f3a-48ea930dc815 could not be found. Aug 10 13:47:59.713479 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-10233918-9c27-40cf-85b9-8178c5199fb5 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Request method failure captured: Aug 10 13:47:59.713479 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: request: GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815 HTTP/1.1 Aug 10 13:47:59.713479 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept: application/json Aug 10 13:47:59.713479 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Accept-Encoding: identity Aug 10 13:47:59.713479 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Connection: close Aug 10 13:47:59.713479 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Length: 0 Aug 10 13:47:59.713479 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Content-Type: application/json Aug 10 13:47:59.713479 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Host: 10.222.0.52 Aug 10 13:47:59.713479 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Openstack-System-Scope: None Aug 10 13:47:59.713479 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: User-Agent: python-urllib3/1.26.11 Aug 10 13:47:59.713479 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Auth-Token: gAAAAABi87Z0KjBe8kPGBxUYhNqk4l_P-9dBXG9gSgFsEaKt9RpWq_Aop_rJXmSzxcSzrvM1VPnxx6U64IzIUMvVlFsbgeqqCRzmYNHR6ZMJTxqE8Ox3AM4JQJfqk42Vjw2rPwtSSc8WnLBodNZzmv78sHXSUUtwdV6Vc86HuXSaektfKpGcpJA Aug 10 13:47:59.713479 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Id: None Aug 10 13:47:59.713479 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Domain-Name: None Aug 10 13:47:59.713479 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Identity-Status: Confirmed Aug 10 13:47:59.713479 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Is-Admin-Project: True Aug 10 13:47:59.713479 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Id: default Aug 10 13:47:59.713479 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Domain-Name: Default Aug 10 13:47:59.713479 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Id: bf531c40d3f74fa6aaf3d26794dca09c Aug 10 13:47:59.713479 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1110532079 Aug 10 13:47:59.713479 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Role: member,reader Aug 10 13:47:59.713479 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Roles: member,reader Aug 10 13:47:59.714981 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bf531c40d3f74fa6aaf3d26794dca09c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bf531c40d3f74fa6aaf3d26794dca09c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bf531c40d3f74fa6aaf3d26794dca09c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bf531c40d3f74fa6aaf3d26794dca09c"}]}] Aug 10 13:47:59.714981 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant: tempest-VolumesSnapshotTestJSON-1110532079 Aug 10 13:47:59.714981 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Id: bf531c40d3f74fa6aaf3d26794dca09c Aug 10 13:47:59.714981 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1110532079 Aug 10 13:47:59.714981 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User: tempest-VolumesSnapshotTestJSON-1110532079-project Aug 10 13:47:59.714981 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Id: default Aug 10 13:47:59.714981 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Domain-Name: Default Aug 10 13:47:59.714981 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Id: 0968c56b8be242918903711961b6d5c0 Aug 10 13:47:59.714981 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: X-User-Name: tempest-VolumesSnapshotTestJSON-1110532079-project Aug 10 13:47:59.714981 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: method: > Aug 10 13:47:59.714981 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: exception: Instance ab3fe1fe-15d6-45b2-8f3a-48ea930dc815 could not be found. Aug 10 13:47:59.714981 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: action_args: {'id': 'ab3fe1fe-15d6-45b2-8f3a-48ea930dc815'} Aug 10 13:47:59.716005 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:47:59.716005 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:47:59.716005 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:47:59.716005 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:47:59.716005 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:47:59.716005 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:47:59.716005 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:47:59.716005 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:47:59.716005 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:47:59.716005 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:47:59.716005 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab3fe1fe-15d6-45b2-8f3a-48ea930dc815 could not be found. Aug 10 13:47:59.716005 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:47:59.716005 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:47:59.716005 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:47:59.716005 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:47:59.716005 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:47:59.716005 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:47:59.716005 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:47:59.716005 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:47:59.716005 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:47:59.717522 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:47:59.717522 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:47:59.717522 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:47:59.717522 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:47:59.717522 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:47:59.717522 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:47:59.717522 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:47:59.717522 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab3fe1fe-15d6-45b2-8f3a-48ea930dc815 could not be found. Aug 10 13:47:59.717522 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:47:59.717522 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:47:59.717522 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:47:59.717522 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:47:59.717522 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:47:59.717522 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:47:59.717522 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:47:59.717522 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:47:59.717522 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab3fe1fe-15d6-45b2-8f3a-48ea930dc815 could not be found. Aug 10 13:47:59.717522 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR nova.api.openstack.wsgi Aug 10 13:47:59.718784 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-10233918-9c27-40cf-85b9-8178c5199fb5 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] Returning 404 to user: Instance ab3fe1fe-15d6-45b2-8f3a-48ea930dc815 could not be found. {{(pid=129523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:47:59.718784 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-10233918-9c27-40cf-85b9-8178c5199fb5 tempest-VolumesSnapshotTestJSON-1110532079 tempest-VolumesSnapshotTestJSON-1110532079-project] 10.222.0.52 "GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815" status: 404 len: 111 microversion: 2.1 time: 0.033040 Aug 10 13:47:59.718784 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 495/1021] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:47:59 2022] GET /compute/v2.1/servers/ab3fe1fe-15d6-45b2-8f3a-48ea930dc815 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:47:59.778394 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-4b14d4d0-5e02-4675-a59b-72b228af96b2 req-2f7fba1b-ef18-4723-a3b0-630bb509d3cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "693f95ba-4b43-4f87-88a3-80c2c0ec0fb7", "tag": "73ad5c6e-fab3-44a5-a197-0f1d119186b9"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:47:59.789653 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-4b14d4d0-5e02-4675-a59b-72b228af96b2 req-2f7fba1b-ef18-4723-a3b0-630bb509d3cc service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:47:59.790232 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-4b14d4d0-5e02-4675-a59b-72b228af96b2 req-2f7fba1b-ef18-4723-a3b0-630bb509d3cc service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:47:59.790734 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-4b14d4d0-5e02-4675-a59b-72b228af96b2 req-2f7fba1b-ef18-4723-a3b0-630bb509d3cc service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:47:59.803457 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-4b14d4d0-5e02-4675-a59b-72b228af96b2 req-2f7fba1b-ef18-4723-a3b0-630bb509d3cc service nova] Creating event network-changed:73ad5c6e-fab3-44a5-a197-0f1d119186b9 for instance 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 on hv-cinder-85200 Aug 10 13:47:59.808735 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-4b14d4d0-5e02-4675-a59b-72b228af96b2 req-2f7fba1b-ef18-4723-a3b0-630bb509d3cc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034767 Aug 10 13:47:59.809800 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 527/1022] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:48:00.353851 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-867a8baa-47bd-47bc-b57b-b4ae1f72866f tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:48:00.354460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-867a8baa-47bd-47bc-b57b-b4ae1f72866f tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:48:00.360415 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-867a8baa-47bd-47bc-b57b-b4ae1f72866f tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:48:00.360896 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-867a8baa-47bd-47bc-b57b-b4ae1f72866f tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:48:00.361379 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-867a8baa-47bd-47bc-b57b-b4ae1f72866f tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:48:00.362173 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-867a8baa-47bd-47bc-b57b-b4ae1f72866f tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:48:00.362825 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-867a8baa-47bd-47bc-b57b-b4ae1f72866f tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:48:00.363245 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-867a8baa-47bd-47bc-b57b-b4ae1f72866f tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:48:00.591533 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-867a8baa-47bd-47bc-b57b-b4ae1f72866f tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:48:00.605426 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-867a8baa-47bd-47bc-b57b-b4ae1f72866f tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1259 microversion: 2.1 time: 0.255878 Aug 10 13:48:00.606012 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 496/1023] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:48:00 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1259 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:48:01.628822 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-79582aab-89c2-4546-a31d-ebcbc1feefc4 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:48:01.629558 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-79582aab-89c2-4546-a31d-ebcbc1feefc4 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:48:01.635736 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-79582aab-89c2-4546-a31d-ebcbc1feefc4 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:48:01.636225 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-79582aab-89c2-4546-a31d-ebcbc1feefc4 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:48:01.636660 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-79582aab-89c2-4546-a31d-ebcbc1feefc4 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:48:01.637418 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-79582aab-89c2-4546-a31d-ebcbc1feefc4 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:48:01.637876 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-79582aab-89c2-4546-a31d-ebcbc1feefc4 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:48:01.638306 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-79582aab-89c2-4546-a31d-ebcbc1feefc4 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:48:01.779600 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-79582aab-89c2-4546-a31d-ebcbc1feefc4 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:48:01.785825 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-79582aab-89c2-4546-a31d-ebcbc1feefc4 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1259 microversion: 2.1 time: 0.161661 Aug 10 13:48:01.786389 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 528/1024] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:48:01 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:48:02.806894 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-ca31d2a2-7794-4ff9-a7fc-f29beccb7946 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:48:02.807643 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-ca31d2a2-7794-4ff9-a7fc-f29beccb7946 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:48:02.814132 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ca31d2a2-7794-4ff9-a7fc-f29beccb7946 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:48:02.814611 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ca31d2a2-7794-4ff9-a7fc-f29beccb7946 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:48:02.815038 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ca31d2a2-7794-4ff9-a7fc-f29beccb7946 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:48:02.815724 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ca31d2a2-7794-4ff9-a7fc-f29beccb7946 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:48:02.816166 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ca31d2a2-7794-4ff9-a7fc-f29beccb7946 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:48:02.816580 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ca31d2a2-7794-4ff9-a7fc-f29beccb7946 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:48:02.950751 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-ca31d2a2-7794-4ff9-a7fc-f29beccb7946 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:48:02.958232 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-ca31d2a2-7794-4ff9-a7fc-f29beccb7946 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1259 microversion: 2.1 time: 0.155762 Aug 10 13:48:02.958792 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 497/1025] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:48:02 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:48:03.979583 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-0441dd9c-285f-4c79-af99-cf2bab2d5530 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:48:03.980234 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-0441dd9c-285f-4c79-af99-cf2bab2d5530 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:48:03.986728 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0441dd9c-285f-4c79-af99-cf2bab2d5530 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:48:03.987203 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0441dd9c-285f-4c79-af99-cf2bab2d5530 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:48:03.987885 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0441dd9c-285f-4c79-af99-cf2bab2d5530 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:48:03.988567 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0441dd9c-285f-4c79-af99-cf2bab2d5530 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:48:03.989015 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0441dd9c-285f-4c79-af99-cf2bab2d5530 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:48:03.989464 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0441dd9c-285f-4c79-af99-cf2bab2d5530 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:48:04.120681 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-0441dd9c-285f-4c79-af99-cf2bab2d5530 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:48:04.128549 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-0441dd9c-285f-4c79-af99-cf2bab2d5530 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1259 microversion: 2.1 time: 0.152646 Aug 10 13:48:04.129110 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 529/1026] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:48:03 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:48:05.150163 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-96922dcc-36f5-4b1d-b9f7-41f4bb270d6c tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:48:05.150797 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-96922dcc-36f5-4b1d-b9f7-41f4bb270d6c tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:48:05.157201 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-96922dcc-36f5-4b1d-b9f7-41f4bb270d6c tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:48:05.157710 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-96922dcc-36f5-4b1d-b9f7-41f4bb270d6c tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:48:05.158141 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-96922dcc-36f5-4b1d-b9f7-41f4bb270d6c tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:48:05.158829 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-96922dcc-36f5-4b1d-b9f7-41f4bb270d6c tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:48:05.159275 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-96922dcc-36f5-4b1d-b9f7-41f4bb270d6c tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:48:05.159693 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-96922dcc-36f5-4b1d-b9f7-41f4bb270d6c tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:48:05.303107 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-96922dcc-36f5-4b1d-b9f7-41f4bb270d6c tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:48:05.310653 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-96922dcc-36f5-4b1d-b9f7-41f4bb270d6c tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1259 microversion: 2.1 time: 0.164970 Aug 10 13:48:05.311223 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 498/1027] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:48:05 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:48:06.331373 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-b33bd310-daa2-48b0-8a05-01222433bf58 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:48:06.332021 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-b33bd310-daa2-48b0-8a05-01222433bf58 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:48:06.334611 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell0:SELECT=2 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:48:06.340138 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b33bd310-daa2-48b0-8a05-01222433bf58 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:48:06.340665 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b33bd310-daa2-48b0-8a05-01222433bf58 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:48:06.341088 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b33bd310-daa2-48b0-8a05-01222433bf58 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:48:06.342003 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b33bd310-daa2-48b0-8a05-01222433bf58 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:48:06.342466 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b33bd310-daa2-48b0-8a05-01222433bf58 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:48:06.342890 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b33bd310-daa2-48b0-8a05-01222433bf58 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:48:06.485352 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-b33bd310-daa2-48b0-8a05-01222433bf58 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:48:06.495106 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-b33bd310-daa2-48b0-8a05-01222433bf58 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1259 microversion: 2.1 time: 0.167640 Aug 10 13:48:06.495679 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 530/1028] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:48:06 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:48:07.515392 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-db015cd5-eafd-4c01-bafd-681982552581 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:48:07.515970 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-db015cd5-eafd-4c01-bafd-681982552581 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:48:07.518093 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell0:SELECT=2 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:48:07.518754 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell0:SELECT=6 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:48:07.525845 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-db015cd5-eafd-4c01-bafd-681982552581 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:48:07.526331 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-db015cd5-eafd-4c01-bafd-681982552581 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:48:07.526772 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-db015cd5-eafd-4c01-bafd-681982552581 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:48:07.527464 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-db015cd5-eafd-4c01-bafd-681982552581 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:48:07.527919 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-db015cd5-eafd-4c01-bafd-681982552581 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:48:07.528342 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-db015cd5-eafd-4c01-bafd-681982552581 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:48:07.668949 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-db015cd5-eafd-4c01-bafd-681982552581 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:48:07.676621 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-db015cd5-eafd-4c01-bafd-681982552581 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1259 microversion: 2.1 time: 0.165372 Aug 10 13:48:07.677435 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 499/1029] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:48:07 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:48:08.697048 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-fbfdc7c9-7547-4310-9e71-49496b08b1bf tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:48:08.697723 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-fbfdc7c9-7547-4310-9e71-49496b08b1bf tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:48:08.704245 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fbfdc7c9-7547-4310-9e71-49496b08b1bf tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:48:08.704721 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fbfdc7c9-7547-4310-9e71-49496b08b1bf tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:48:08.705147 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fbfdc7c9-7547-4310-9e71-49496b08b1bf tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:48:08.705857 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fbfdc7c9-7547-4310-9e71-49496b08b1bf tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:48:08.706305 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fbfdc7c9-7547-4310-9e71-49496b08b1bf tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:48:08.706723 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-fbfdc7c9-7547-4310-9e71-49496b08b1bf tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:48:08.840528 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-fbfdc7c9-7547-4310-9e71-49496b08b1bf tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:48:08.852637 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-fbfdc7c9-7547-4310-9e71-49496b08b1bf tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1259 microversion: 2.1 time: 0.155004 Aug 10 13:48:08.853215 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 531/1030] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:48:08 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:48:09.874035 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-4f5f5d09-6325-4a05-a252-45809f6830f6 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:48:09.874642 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-4f5f5d09-6325-4a05-a252-45809f6830f6 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:48:09.882133 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4f5f5d09-6325-4a05-a252-45809f6830f6 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:48:09.882763 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4f5f5d09-6325-4a05-a252-45809f6830f6 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:48:09.883194 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4f5f5d09-6325-4a05-a252-45809f6830f6 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:48:09.883875 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4f5f5d09-6325-4a05-a252-45809f6830f6 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:48:09.884322 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4f5f5d09-6325-4a05-a252-45809f6830f6 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:48:09.884746 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4f5f5d09-6325-4a05-a252-45809f6830f6 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:48:10.015467 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-4f5f5d09-6325-4a05-a252-45809f6830f6 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:48:10.024777 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-4f5f5d09-6325-4a05-a252-45809f6830f6 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1259 microversion: 2.1 time: 0.154437 Aug 10 13:48:10.025796 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 500/1031] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:48:09 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:48:11.046430 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-e6b8881e-edb0-4bdd-bec6-e8f8d731e703 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:48:11.047062 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-e6b8881e-edb0-4bdd-bec6-e8f8d731e703 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:48:11.053523 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e6b8881e-edb0-4bdd-bec6-e8f8d731e703 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:48:11.054000 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e6b8881e-edb0-4bdd-bec6-e8f8d731e703 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:48:11.054426 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e6b8881e-edb0-4bdd-bec6-e8f8d731e703 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:48:11.055098 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e6b8881e-edb0-4bdd-bec6-e8f8d731e703 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:48:11.055544 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e6b8881e-edb0-4bdd-bec6-e8f8d731e703 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:48:11.055958 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-e6b8881e-edb0-4bdd-bec6-e8f8d731e703 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:48:11.194033 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-e6b8881e-edb0-4bdd-bec6-e8f8d731e703 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:48:11.201422 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-e6b8881e-edb0-4bdd-bec6-e8f8d731e703 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1259 microversion: 2.1 time: 0.158895 Aug 10 13:48:11.201980 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 532/1032] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:48:11 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:48:11.721998 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [req-312d85ff-0293-46eb-a4ec-86ffbccf52bb req-7a22dbd1-079b-4390-95d9-654f5610a7ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "693f95ba-4b43-4f87-88a3-80c2c0ec0fb7", "name": "network-vif-plugged", "status": "completed", "tag": "73ad5c6e-fab3-44a5-a197-0f1d119186b9"}]} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:48:11.741259 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-312d85ff-0293-46eb-a4ec-86ffbccf52bb req-7a22dbd1-079b-4390-95d9-654f5610a7ab service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:48:11.742108 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-312d85ff-0293-46eb-a4ec-86ffbccf52bb req-7a22dbd1-079b-4390-95d9-654f5610a7ab service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:48:11.742866 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [req-312d85ff-0293-46eb-a4ec-86ffbccf52bb req-7a22dbd1-079b-4390-95d9-654f5610a7ab service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:48:11.764042 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.compute.server_external_events [req-312d85ff-0293-46eb-a4ec-86ffbccf52bb req-7a22dbd1-079b-4390-95d9-654f5610a7ab service nova] Creating event network-vif-plugged:73ad5c6e-fab3-44a5-a197-0f1d119186b9 for instance 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 on hv-cinder-85200 Aug 10 13:48:11.773355 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [req-312d85ff-0293-46eb-a4ec-86ffbccf52bb req-7a22dbd1-079b-4390-95d9-654f5610a7ab service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057335 Aug 10 13:48:11.774329 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 501/1033] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:48:12.223160 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-99b893f8-f891-4ce4-b198-40b0537c05b2 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:48:12.223767 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-99b893f8-f891-4ce4-b198-40b0537c05b2 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:48:12.231217 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-99b893f8-f891-4ce4-b198-40b0537c05b2 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:48:12.231695 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-99b893f8-f891-4ce4-b198-40b0537c05b2 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:48:12.232750 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-99b893f8-f891-4ce4-b198-40b0537c05b2 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:48:12.232940 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-99b893f8-f891-4ce4-b198-40b0537c05b2 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:48:12.233339 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-99b893f8-f891-4ce4-b198-40b0537c05b2 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:48:12.233873 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-99b893f8-f891-4ce4-b198-40b0537c05b2 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:48:12.384394 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-99b893f8-f891-4ce4-b198-40b0537c05b2 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:48:12.393204 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-99b893f8-f891-4ce4-b198-40b0537c05b2 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1259 microversion: 2.1 time: 0.173944 Aug 10 13:48:12.393982 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 533/1034] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:48:12 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:48:13.416623 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-ff92f54d-a04a-4dfd-b8f1-815e09ada950 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:48:13.417392 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-ff92f54d-a04a-4dfd-b8f1-815e09ada950 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:48:13.424343 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ff92f54d-a04a-4dfd-b8f1-815e09ada950 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:48:13.424853 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ff92f54d-a04a-4dfd-b8f1-815e09ada950 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:48:13.425310 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ff92f54d-a04a-4dfd-b8f1-815e09ada950 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:48:13.426033 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ff92f54d-a04a-4dfd-b8f1-815e09ada950 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:48:13.426490 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ff92f54d-a04a-4dfd-b8f1-815e09ada950 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:48:13.426914 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ff92f54d-a04a-4dfd-b8f1-815e09ada950 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:48:13.568449 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-ff92f54d-a04a-4dfd-b8f1-815e09ada950 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:48:13.577017 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-ff92f54d-a04a-4dfd-b8f1-815e09ada950 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1259 microversion: 2.1 time: 0.165821 Aug 10 13:48:13.577963 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 502/1035] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:48:13 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:48:14.600084 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-d6c29bbe-d63b-49d6-b7f3-5fe0713d589e tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:48:14.601418 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-d6c29bbe-d63b-49d6-b7f3-5fe0713d589e tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:48:14.607931 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d6c29bbe-d63b-49d6-b7f3-5fe0713d589e tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:48:14.608422 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d6c29bbe-d63b-49d6-b7f3-5fe0713d589e tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:48:14.608856 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d6c29bbe-d63b-49d6-b7f3-5fe0713d589e tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:48:14.609602 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d6c29bbe-d63b-49d6-b7f3-5fe0713d589e tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:48:14.610154 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d6c29bbe-d63b-49d6-b7f3-5fe0713d589e tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:48:14.610584 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-d6c29bbe-d63b-49d6-b7f3-5fe0713d589e tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:48:14.746674 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-d6c29bbe-d63b-49d6-b7f3-5fe0713d589e tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:48:14.754222 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-d6c29bbe-d63b-49d6-b7f3-5fe0713d589e tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1444 microversion: 2.1 time: 0.159412 Aug 10 13:48:14.754775 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 534/1036] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:48:14 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1444 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:48:14.773780 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-86310f6f-889c-44a1-bdc6-b4b65db1decf tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:48:14.774396 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-86310f6f-889c-44a1-bdc6-b4b65db1decf tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:48:14.781934 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-86310f6f-889c-44a1-bdc6-b4b65db1decf tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:48:14.782418 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-86310f6f-889c-44a1-bdc6-b4b65db1decf tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:48:14.782851 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-86310f6f-889c-44a1-bdc6-b4b65db1decf tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:48:14.783540 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-86310f6f-889c-44a1-bdc6-b4b65db1decf tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:48:14.783994 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-86310f6f-889c-44a1-bdc6-b4b65db1decf tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:48:14.784422 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-86310f6f-889c-44a1-bdc6-b4b65db1decf tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:48:14.923256 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-86310f6f-889c-44a1-bdc6-b4b65db1decf tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:48:14.931014 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-86310f6f-889c-44a1-bdc6-b4b65db1decf tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1444 microversion: 2.1 time: 0.161014 Aug 10 13:48:14.931596 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 503/1037] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:48:14 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1444 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:48:16.679071 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-12698fbf-13c2-439d-b5db-e1a42e998e34 req-1824976c-aabf-4063-a3ea-ee3aaf68e84f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "693f95ba-4b43-4f87-88a3-80c2c0ec0fb7", "tag": "73ad5c6e-fab3-44a5-a197-0f1d119186b9"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:48:16.690296 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-12698fbf-13c2-439d-b5db-e1a42e998e34 req-1824976c-aabf-4063-a3ea-ee3aaf68e84f service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:48:16.690771 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-12698fbf-13c2-439d-b5db-e1a42e998e34 req-1824976c-aabf-4063-a3ea-ee3aaf68e84f service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:48:16.691193 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-12698fbf-13c2-439d-b5db-e1a42e998e34 req-1824976c-aabf-4063-a3ea-ee3aaf68e84f service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:48:16.702747 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-12698fbf-13c2-439d-b5db-e1a42e998e34 req-1824976c-aabf-4063-a3ea-ee3aaf68e84f service nova] Creating event network-changed:73ad5c6e-fab3-44a5-a197-0f1d119186b9 for instance 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 on hv-cinder-85200 Aug 10 13:48:16.708135 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-12698fbf-13c2-439d-b5db-e1a42e998e34 req-1824976c-aabf-4063-a3ea-ee3aaf68e84f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035176 Aug 10 13:48:16.709309 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 535/1038] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:49:33.086858 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:49:33.087725 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Wed Aug 10 13:49:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 13:50:11.960583 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR oslo.messaging._drivers.impl_rabbit [-] [183e5cf4-f511-4810-b61f-66e3d53236a3] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 10 13:50:11.961449 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:50:11.962187 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:50:11.966536 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-4f861be5-4353-4110-bfd1-50501d2a1b94 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:50:11.967072 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-4f861be5-4353-4110-bfd1-50501d2a1b94 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:50:11.975567 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4f861be5-4353-4110-bfd1-50501d2a1b94 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:11.976059 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4f861be5-4353-4110-bfd1-50501d2a1b94 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:11.976524 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4f861be5-4353-4110-bfd1-50501d2a1b94 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:11.977277 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4f861be5-4353-4110-bfd1-50501d2a1b94 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:11.977737 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4f861be5-4353-4110-bfd1-50501d2a1b94 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:11.978230 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-4f861be5-4353-4110-bfd1-50501d2a1b94 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:12.004194 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.objects.instance [None req-4f861be5-4353-4110-bfd1-50501d2a1b94 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lazy-loading 'flavor' on Instance uuid 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 {{(pid=129523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:50:12.089342 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-4f861be5-4353-4110-bfd1-50501d2a1b94 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "POST /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7/action" status: 202 len: 0 microversion: 2.1 time: 0.130479 Aug 10 13:50:12.089987 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 504/1039] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 10 13:50:11 2022] POST /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 13:50:12.096885 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e0939d75-a3ca-4b43-ad71-1583ab185c7c] AMQP server on 10.222.0.52:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 10 13:50:12.098758 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_api:SELECT=32 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:50:12.099781 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=1 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:50:12.104517 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-b4f2e5fd-2fe0-4185-8886-1bf413858694 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:50:12.105260 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-b4f2e5fd-2fe0-4185-8886-1bf413858694 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:50:12.113898 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b4f2e5fd-2fe0-4185-8886-1bf413858694 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:12.114384 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b4f2e5fd-2fe0-4185-8886-1bf413858694 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:12.114813 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b4f2e5fd-2fe0-4185-8886-1bf413858694 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:12.115764 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b4f2e5fd-2fe0-4185-8886-1bf413858694 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:12.116209 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b4f2e5fd-2fe0-4185-8886-1bf413858694 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:12.116624 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-b4f2e5fd-2fe0-4185-8886-1bf413858694 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:12.269284 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-b4f2e5fd-2fe0-4185-8886-1bf413858694 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:50:12.277662 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-b4f2e5fd-2fe0-4185-8886-1bf413858694 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1569 microversion: 2.1 time: 0.182506 Aug 10 13:50:12.278248 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 536/1040] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:50:12 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:50:13.302028 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-2f27dab6-eb6f-4766-9e9d-189aff7bfbfd tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:50:13.302764 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-2f27dab6-eb6f-4766-9e9d-189aff7bfbfd tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:50:13.309564 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2f27dab6-eb6f-4766-9e9d-189aff7bfbfd tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:13.310046 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2f27dab6-eb6f-4766-9e9d-189aff7bfbfd tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:13.310479 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2f27dab6-eb6f-4766-9e9d-189aff7bfbfd tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:13.311171 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2f27dab6-eb6f-4766-9e9d-189aff7bfbfd tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:13.311624 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2f27dab6-eb6f-4766-9e9d-189aff7bfbfd tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:13.312045 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-2f27dab6-eb6f-4766-9e9d-189aff7bfbfd tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:13.317460 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO oslo.messaging._drivers.impl_rabbit [-] [183e5cf4-f511-4810-b61f-66e3d53236a3] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 37346. Aug 10 13:50:13.451082 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-2f27dab6-eb6f-4766-9e9d-189aff7bfbfd tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:50:13.459198 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-2f27dab6-eb6f-4766-9e9d-189aff7bfbfd tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1569 microversion: 2.1 time: 0.163013 Aug 10 13:50:13.459753 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 505/1041] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:50:13 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:50:14.480494 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-03a1f759-213a-4d17-9689-b822e1c11e07 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:50:14.481094 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-03a1f759-213a-4d17-9689-b822e1c11e07 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:50:14.488450 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-03a1f759-213a-4d17-9689-b822e1c11e07 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:14.488998 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-03a1f759-213a-4d17-9689-b822e1c11e07 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:14.489541 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-03a1f759-213a-4d17-9689-b822e1c11e07 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:14.490546 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-03a1f759-213a-4d17-9689-b822e1c11e07 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:14.491003 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-03a1f759-213a-4d17-9689-b822e1c11e07 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:14.491508 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-03a1f759-213a-4d17-9689-b822e1c11e07 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:14.497799 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO oslo.messaging._drivers.impl_rabbit [-] [e0939d75-a3ca-4b43-ad71-1583ab185c7c] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 37350. Aug 10 13:50:14.624794 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-03a1f759-213a-4d17-9689-b822e1c11e07 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:50:14.634313 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-03a1f759-213a-4d17-9689-b822e1c11e07 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1569 microversion: 2.1 time: 0.157751 Aug 10 13:50:14.634878 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 537/1042] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:50:14 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:50:15.656678 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-db28d061-3a0d-4e9d-aa65-0892468ef194 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:50:15.657315 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-db28d061-3a0d-4e9d-aa65-0892468ef194 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:50:15.664333 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-db28d061-3a0d-4e9d-aa65-0892468ef194 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:15.664815 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-db28d061-3a0d-4e9d-aa65-0892468ef194 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:15.665264 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-db28d061-3a0d-4e9d-aa65-0892468ef194 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:15.665966 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-db28d061-3a0d-4e9d-aa65-0892468ef194 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:15.666413 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-db28d061-3a0d-4e9d-aa65-0892468ef194 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:15.666831 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-db28d061-3a0d-4e9d-aa65-0892468ef194 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:15.799371 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-db28d061-3a0d-4e9d-aa65-0892468ef194 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:50:15.806560 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-db28d061-3a0d-4e9d-aa65-0892468ef194 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1569 microversion: 2.1 time: 0.154068 Aug 10 13:50:15.807124 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 506/1043] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:50:15 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:50:16.827011 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-236472ce-08c2-4160-a813-4026b8fdc715 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:50:16.827615 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-236472ce-08c2-4160-a813-4026b8fdc715 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:50:16.834096 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-236472ce-08c2-4160-a813-4026b8fdc715 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:16.834581 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-236472ce-08c2-4160-a813-4026b8fdc715 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:16.835018 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-236472ce-08c2-4160-a813-4026b8fdc715 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:16.835706 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-236472ce-08c2-4160-a813-4026b8fdc715 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:16.836159 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-236472ce-08c2-4160-a813-4026b8fdc715 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:16.836580 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-236472ce-08c2-4160-a813-4026b8fdc715 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:16.976518 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-236472ce-08c2-4160-a813-4026b8fdc715 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:50:16.985035 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-236472ce-08c2-4160-a813-4026b8fdc715 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1569 microversion: 2.1 time: 0.161950 Aug 10 13:50:16.985635 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 538/1044] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:50:16 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:50:18.006452 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-1f157538-7ab5-4bc2-890c-37df3df98a5b tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:50:18.007052 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-1f157538-7ab5-4bc2-890c-37df3df98a5b tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:50:18.013930 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1f157538-7ab5-4bc2-890c-37df3df98a5b tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:18.014410 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1f157538-7ab5-4bc2-890c-37df3df98a5b tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:18.014838 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1f157538-7ab5-4bc2-890c-37df3df98a5b tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:18.015521 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1f157538-7ab5-4bc2-890c-37df3df98a5b tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:18.015970 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1f157538-7ab5-4bc2-890c-37df3df98a5b tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:18.016386 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-1f157538-7ab5-4bc2-890c-37df3df98a5b tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:18.152468 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-1f157538-7ab5-4bc2-890c-37df3df98a5b tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:50:18.161803 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-1f157538-7ab5-4bc2-890c-37df3df98a5b tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1569 microversion: 2.1 time: 0.159092 Aug 10 13:50:18.162420 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 507/1045] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:50:18 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:50:19.183458 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-519a12d6-948d-4cd7-87f2-e872869573dc tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:50:19.184062 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-519a12d6-948d-4cd7-87f2-e872869573dc tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:50:19.190483 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-519a12d6-948d-4cd7-87f2-e872869573dc tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:19.190969 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-519a12d6-948d-4cd7-87f2-e872869573dc tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:19.191402 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-519a12d6-948d-4cd7-87f2-e872869573dc tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:19.192081 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-519a12d6-948d-4cd7-87f2-e872869573dc tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:19.192565 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-519a12d6-948d-4cd7-87f2-e872869573dc tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:19.192987 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-519a12d6-948d-4cd7-87f2-e872869573dc tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:19.328295 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-519a12d6-948d-4cd7-87f2-e872869573dc tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:50:19.335811 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-519a12d6-948d-4cd7-87f2-e872869573dc tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1569 microversion: 2.1 time: 0.156268 Aug 10 13:50:19.336366 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 539/1046] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:50:19 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:50:20.357356 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-8d45634c-8c1e-4ad6-8328-3c619c15af98 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:50:20.357959 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-8d45634c-8c1e-4ad6-8328-3c619c15af98 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:50:20.364912 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8d45634c-8c1e-4ad6-8328-3c619c15af98 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:20.365695 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8d45634c-8c1e-4ad6-8328-3c619c15af98 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:20.366131 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8d45634c-8c1e-4ad6-8328-3c619c15af98 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:20.366830 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8d45634c-8c1e-4ad6-8328-3c619c15af98 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:20.368040 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8d45634c-8c1e-4ad6-8328-3c619c15af98 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:20.368040 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-8d45634c-8c1e-4ad6-8328-3c619c15af98 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:20.506227 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-8d45634c-8c1e-4ad6-8328-3c619c15af98 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:50:20.514111 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-8d45634c-8c1e-4ad6-8328-3c619c15af98 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1569 microversion: 2.1 time: 0.160646 Aug 10 13:50:20.514704 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 508/1047] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:50:20 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:50:21.539382 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-351e9061-211c-4929-b1d6-7896def9908b tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:50:21.540004 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-351e9061-211c-4929-b1d6-7896def9908b tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:50:21.546487 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-351e9061-211c-4929-b1d6-7896def9908b tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:21.546972 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-351e9061-211c-4929-b1d6-7896def9908b tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:21.547402 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-351e9061-211c-4929-b1d6-7896def9908b tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:21.548108 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-351e9061-211c-4929-b1d6-7896def9908b tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:21.548555 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-351e9061-211c-4929-b1d6-7896def9908b tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:21.549006 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-351e9061-211c-4929-b1d6-7896def9908b tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:21.691452 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-351e9061-211c-4929-b1d6-7896def9908b tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:50:21.701302 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-351e9061-211c-4929-b1d6-7896def9908b tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1569 microversion: 2.1 time: 0.165777 Aug 10 13:50:21.702079 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 540/1048] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:50:21 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:50:22.733329 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-a126558d-efa3-4eb0-a111-04c0fce172d7 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:50:22.733938 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-a126558d-efa3-4eb0-a111-04c0fce172d7 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:50:22.740910 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a126558d-efa3-4eb0-a111-04c0fce172d7 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:22.741441 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a126558d-efa3-4eb0-a111-04c0fce172d7 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:22.741875 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a126558d-efa3-4eb0-a111-04c0fce172d7 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:22.742582 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a126558d-efa3-4eb0-a111-04c0fce172d7 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:22.743032 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a126558d-efa3-4eb0-a111-04c0fce172d7 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:22.743446 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-a126558d-efa3-4eb0-a111-04c0fce172d7 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:22.878156 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-a126558d-efa3-4eb0-a111-04c0fce172d7 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:50:22.886299 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-a126558d-efa3-4eb0-a111-04c0fce172d7 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1569 microversion: 2.1 time: 0.156920 Aug 10 13:50:22.886872 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 509/1049] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:50:22 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:50:23.907824 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-f75a6510-a5c4-4946-aa38-152c11e07f42 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:50:23.908425 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-f75a6510-a5c4-4946-aa38-152c11e07f42 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:50:23.915021 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f75a6510-a5c4-4946-aa38-152c11e07f42 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:23.915504 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f75a6510-a5c4-4946-aa38-152c11e07f42 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:23.915937 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f75a6510-a5c4-4946-aa38-152c11e07f42 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:23.916632 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f75a6510-a5c4-4946-aa38-152c11e07f42 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:23.917086 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f75a6510-a5c4-4946-aa38-152c11e07f42 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:23.917551 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-f75a6510-a5c4-4946-aa38-152c11e07f42 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:24.051773 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-f75a6510-a5c4-4946-aa38-152c11e07f42 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:50:24.059458 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-f75a6510-a5c4-4946-aa38-152c11e07f42 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1569 microversion: 2.1 time: 0.155504 Aug 10 13:50:24.060016 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 541/1050] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:50:23 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:50:25.081015 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-cb4353cb-0bf5-4b3a-aba3-4cffd5e0ab31 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:50:25.081715 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-cb4353cb-0bf5-4b3a-aba3-4cffd5e0ab31 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:50:25.088686 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cb4353cb-0bf5-4b3a-aba3-4cffd5e0ab31 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:25.089169 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cb4353cb-0bf5-4b3a-aba3-4cffd5e0ab31 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:25.089640 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cb4353cb-0bf5-4b3a-aba3-4cffd5e0ab31 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:25.090331 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cb4353cb-0bf5-4b3a-aba3-4cffd5e0ab31 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:25.090782 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cb4353cb-0bf5-4b3a-aba3-4cffd5e0ab31 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:25.091228 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-cb4353cb-0bf5-4b3a-aba3-4cffd5e0ab31 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:25.238724 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-cb4353cb-0bf5-4b3a-aba3-4cffd5e0ab31 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:50:25.246617 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-cb4353cb-0bf5-4b3a-aba3-4cffd5e0ab31 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1510 microversion: 2.1 time: 0.169530 Aug 10 13:50:25.247191 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 510/1051] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:50:25 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:50:25.267369 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-c4d74ee4-f484-45c8-84be-50940b71a2bc tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:50:25.267967 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-c4d74ee4-f484-45c8-84be-50940b71a2bc tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:50:25.275182 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c4d74ee4-f484-45c8-84be-50940b71a2bc tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:25.275705 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c4d74ee4-f484-45c8-84be-50940b71a2bc tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:25.276136 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c4d74ee4-f484-45c8-84be-50940b71a2bc tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:25.276831 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c4d74ee4-f484-45c8-84be-50940b71a2bc tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:25.277302 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c4d74ee4-f484-45c8-84be-50940b71a2bc tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:25.277726 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-c4d74ee4-f484-45c8-84be-50940b71a2bc tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:25.305514 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-c4d74ee4-f484-45c8-84be-50940b71a2bc tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129522) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 10 13:50:25.371042 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-c4d74ee4-f484-45c8-84be-50940b71a2bc tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "POST /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7/action" status: 202 len: 0 microversion: 2.1 time: 0.107474 Aug 10 13:50:25.371562 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 542/1052] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 10 13:50:25 2022] POST /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:50:25.380212 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-d96afb3a-b281-4345-8c6a-ab1f8f1e9e82 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:50:25.380830 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-d96afb3a-b281-4345-8c6a-ab1f8f1e9e82 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:50:25.387083 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d96afb3a-b281-4345-8c6a-ab1f8f1e9e82 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:25.387572 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d96afb3a-b281-4345-8c6a-ab1f8f1e9e82 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:25.388011 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d96afb3a-b281-4345-8c6a-ab1f8f1e9e82 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:25.388712 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d96afb3a-b281-4345-8c6a-ab1f8f1e9e82 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:25.389169 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d96afb3a-b281-4345-8c6a-ab1f8f1e9e82 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:25.389622 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-d96afb3a-b281-4345-8c6a-ab1f8f1e9e82 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:25.523183 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-d96afb3a-b281-4345-8c6a-ab1f8f1e9e82 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:50:25.536051 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-d96afb3a-b281-4345-8c6a-ab1f8f1e9e82 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1518 microversion: 2.1 time: 0.159795 Aug 10 13:50:25.536945 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 511/1053] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:50:25 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:50:26.558399 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-0c709561-ac8b-4299-bb8c-84cda5b8a702 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:50:26.558950 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-0c709561-ac8b-4299-bb8c-84cda5b8a702 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:50:26.565370 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0c709561-ac8b-4299-bb8c-84cda5b8a702 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:26.565858 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0c709561-ac8b-4299-bb8c-84cda5b8a702 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:26.566313 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0c709561-ac8b-4299-bb8c-84cda5b8a702 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:26.567542 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0c709561-ac8b-4299-bb8c-84cda5b8a702 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:26.567996 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0c709561-ac8b-4299-bb8c-84cda5b8a702 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:26.568455 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0c709561-ac8b-4299-bb8c-84cda5b8a702 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:26.721642 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-0c709561-ac8b-4299-bb8c-84cda5b8a702 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:50:26.730187 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-0c709561-ac8b-4299-bb8c-84cda5b8a702 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1520 microversion: 2.1 time: 0.176428 Aug 10 13:50:26.730767 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 543/1054] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:50:26 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:50:27.753288 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-85298504-344f-40ad-a9a1-b38fe7fa5cf2 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:50:27.753863 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-85298504-344f-40ad-a9a1-b38fe7fa5cf2 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:50:27.760070 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-85298504-344f-40ad-a9a1-b38fe7fa5cf2 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:27.760547 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-85298504-344f-40ad-a9a1-b38fe7fa5cf2 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:27.760974 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-85298504-344f-40ad-a9a1-b38fe7fa5cf2 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:27.761693 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-85298504-344f-40ad-a9a1-b38fe7fa5cf2 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:27.762144 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-85298504-344f-40ad-a9a1-b38fe7fa5cf2 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:27.762559 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-85298504-344f-40ad-a9a1-b38fe7fa5cf2 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:27.926462 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-85298504-344f-40ad-a9a1-b38fe7fa5cf2 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:50:27.937513 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-85298504-344f-40ad-a9a1-b38fe7fa5cf2 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1576 microversion: 2.1 time: 0.188037 Aug 10 13:50:27.938136 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 512/1055] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:50:27 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1576 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:50:28.373717 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-48b4d4e2-29b2-4d54-827f-9045ea93defc req-eb47553e-a481-43c7-a3a0-f59c03a36acd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "693f95ba-4b43-4f87-88a3-80c2c0ec0fb7", "name": "network-vif-unplugged", "status": "completed", "tag": "73ad5c6e-fab3-44a5-a197-0f1d119186b9"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:50:28.385305 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-48b4d4e2-29b2-4d54-827f-9045ea93defc req-eb47553e-a481-43c7-a3a0-f59c03a36acd service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:28.385781 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-48b4d4e2-29b2-4d54-827f-9045ea93defc req-eb47553e-a481-43c7-a3a0-f59c03a36acd service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:28.386203 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-48b4d4e2-29b2-4d54-827f-9045ea93defc req-eb47553e-a481-43c7-a3a0-f59c03a36acd service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:28.397973 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-48b4d4e2-29b2-4d54-827f-9045ea93defc req-eb47553e-a481-43c7-a3a0-f59c03a36acd service nova] Creating event network-vif-unplugged:73ad5c6e-fab3-44a5-a197-0f1d119186b9 for instance 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 on hv-cinder-85200 Aug 10 13:50:28.403825 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-48b4d4e2-29b2-4d54-827f-9045ea93defc req-eb47553e-a481-43c7-a3a0-f59c03a36acd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113603 Aug 10 13:50:28.404442 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 544/1056] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:50:28.960400 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-275844e0-175b-4a59-b6dd-217d701714fc tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:50:28.964473 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-275844e0-175b-4a59-b6dd-217d701714fc tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:50:28.967142 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-275844e0-175b-4a59-b6dd-217d701714fc tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:28.967624 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-275844e0-175b-4a59-b6dd-217d701714fc tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:28.968072 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-275844e0-175b-4a59-b6dd-217d701714fc tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:28.969302 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-275844e0-175b-4a59-b6dd-217d701714fc tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:28.969762 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-275844e0-175b-4a59-b6dd-217d701714fc tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:28.970956 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-275844e0-175b-4a59-b6dd-217d701714fc tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:29.115454 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-275844e0-175b-4a59-b6dd-217d701714fc tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:50:29.123576 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-275844e0-175b-4a59-b6dd-217d701714fc tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1576 microversion: 2.1 time: 0.167439 Aug 10 13:50:29.124213 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 513/1057] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:50:28 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:50:30.155960 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-90d86655-e34b-4441-b09f-a4db235fa65e tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:50:30.157200 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-90d86655-e34b-4441-b09f-a4db235fa65e tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:50:30.168204 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-90d86655-e34b-4441-b09f-a4db235fa65e tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:30.169064 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-90d86655-e34b-4441-b09f-a4db235fa65e tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:30.169883 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-90d86655-e34b-4441-b09f-a4db235fa65e tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:30.171137 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-90d86655-e34b-4441-b09f-a4db235fa65e tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:30.171946 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-90d86655-e34b-4441-b09f-a4db235fa65e tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:30.172698 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-90d86655-e34b-4441-b09f-a4db235fa65e tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:30.343503 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-90d86655-e34b-4441-b09f-a4db235fa65e tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:50:30.352075 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-90d86655-e34b-4441-b09f-a4db235fa65e tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1576 microversion: 2.1 time: 0.204695 Aug 10 13:50:30.352584 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 545/1058] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:50:30 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1576 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:50:31.374091 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-53b432e7-564d-4739-9057-3f2146fa5189 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:50:31.374765 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-53b432e7-564d-4739-9057-3f2146fa5189 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:50:31.381725 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-53b432e7-564d-4739-9057-3f2146fa5189 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:31.382207 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-53b432e7-564d-4739-9057-3f2146fa5189 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:31.382640 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-53b432e7-564d-4739-9057-3f2146fa5189 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:31.383317 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-53b432e7-564d-4739-9057-3f2146fa5189 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:31.383768 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-53b432e7-564d-4739-9057-3f2146fa5189 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:31.384186 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-53b432e7-564d-4739-9057-3f2146fa5189 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:31.521107 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-53b432e7-564d-4739-9057-3f2146fa5189 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:50:31.528772 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-53b432e7-564d-4739-9057-3f2146fa5189 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1576 microversion: 2.1 time: 0.158431 Aug 10 13:50:31.529295 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 514/1059] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:50:31 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:50:32.548769 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-0bd139f3-2a6a-4350-a25e-dba1edb7998e tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:50:32.549452 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-0bd139f3-2a6a-4350-a25e-dba1edb7998e tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:50:32.556433 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0bd139f3-2a6a-4350-a25e-dba1edb7998e tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:32.556975 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0bd139f3-2a6a-4350-a25e-dba1edb7998e tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:32.557437 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0bd139f3-2a6a-4350-a25e-dba1edb7998e tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:32.558125 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0bd139f3-2a6a-4350-a25e-dba1edb7998e tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:32.558610 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0bd139f3-2a6a-4350-a25e-dba1edb7998e tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:32.559031 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-0bd139f3-2a6a-4350-a25e-dba1edb7998e tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:32.693748 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-0bd139f3-2a6a-4350-a25e-dba1edb7998e tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:50:32.701850 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-0bd139f3-2a6a-4350-a25e-dba1edb7998e tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1576 microversion: 2.1 time: 0.156631 Aug 10 13:50:32.702698 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 546/1060] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:50:32 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:50:33.725065 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-6f002211-1d1b-45eb-9028-8e10712e2d9a tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:50:33.725778 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-6f002211-1d1b-45eb-9028-8e10712e2d9a tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:50:33.741206 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6f002211-1d1b-45eb-9028-8e10712e2d9a tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:33.741797 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6f002211-1d1b-45eb-9028-8e10712e2d9a tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:33.742319 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6f002211-1d1b-45eb-9028-8e10712e2d9a tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:33.743259 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6f002211-1d1b-45eb-9028-8e10712e2d9a tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:33.743946 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6f002211-1d1b-45eb-9028-8e10712e2d9a tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:33.744578 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-6f002211-1d1b-45eb-9028-8e10712e2d9a tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:33.965589 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-6f002211-1d1b-45eb-9028-8e10712e2d9a tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:50:33.975864 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-6f002211-1d1b-45eb-9028-8e10712e2d9a tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1576 microversion: 2.1 time: 0.255643 Aug 10 13:50:33.976450 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 515/1061] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:50:33 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1576 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:50:35.007077 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-67b52056-7f3f-4735-92be-f2d2e8ccac7d tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:50:35.007976 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-67b52056-7f3f-4735-92be-f2d2e8ccac7d tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:50:35.015033 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-67b52056-7f3f-4735-92be-f2d2e8ccac7d tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:35.015524 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-67b52056-7f3f-4735-92be-f2d2e8ccac7d tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:35.015956 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-67b52056-7f3f-4735-92be-f2d2e8ccac7d tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:35.016654 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-67b52056-7f3f-4735-92be-f2d2e8ccac7d tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:35.017102 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-67b52056-7f3f-4735-92be-f2d2e8ccac7d tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:35.017546 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-67b52056-7f3f-4735-92be-f2d2e8ccac7d tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:35.190808 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-67b52056-7f3f-4735-92be-f2d2e8ccac7d tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:50:35.199578 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-67b52056-7f3f-4735-92be-f2d2e8ccac7d tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1576 microversion: 2.1 time: 0.196666 Aug 10 13:50:35.200167 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 547/1062] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:50:35 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1576 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:50:36.222512 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-dfa1a4af-ee4c-4944-beea-60d39aee4a7c tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:50:36.223454 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-dfa1a4af-ee4c-4944-beea-60d39aee4a7c tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:50:36.231953 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-dfa1a4af-ee4c-4944-beea-60d39aee4a7c tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:36.232596 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-dfa1a4af-ee4c-4944-beea-60d39aee4a7c tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:36.233174 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-dfa1a4af-ee4c-4944-beea-60d39aee4a7c tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:36.234176 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-dfa1a4af-ee4c-4944-beea-60d39aee4a7c tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:36.234884 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-dfa1a4af-ee4c-4944-beea-60d39aee4a7c tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:36.235485 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-dfa1a4af-ee4c-4944-beea-60d39aee4a7c tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:36.419081 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-dfa1a4af-ee4c-4944-beea-60d39aee4a7c tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:50:36.428272 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-dfa1a4af-ee4c-4944-beea-60d39aee4a7c tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1563 microversion: 2.1 time: 0.211341 Aug 10 13:50:36.429001 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 516/1063] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:50:36 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1563 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:50:38.400485 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-7e69ca02-9eb4-45c7-9e2f-b76aea354c30 req-8e28b5eb-fff0-4781-a95b-a7fc22a6dc0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "693f95ba-4b43-4f87-88a3-80c2c0ec0fb7", "name": "network-vif-plugged", "status": "completed", "tag": "73ad5c6e-fab3-44a5-a197-0f1d119186b9"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:50:38.413261 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-7e69ca02-9eb4-45c7-9e2f-b76aea354c30 req-8e28b5eb-fff0-4781-a95b-a7fc22a6dc0e service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:50:38.413754 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-7e69ca02-9eb4-45c7-9e2f-b76aea354c30 req-8e28b5eb-fff0-4781-a95b-a7fc22a6dc0e service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:50:38.414824 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-7e69ca02-9eb4-45c7-9e2f-b76aea354c30 req-8e28b5eb-fff0-4781-a95b-a7fc22a6dc0e service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:50:38.428090 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-7e69ca02-9eb4-45c7-9e2f-b76aea354c30 req-8e28b5eb-fff0-4781-a95b-a7fc22a6dc0e service nova] Creating event network-vif-plugged:73ad5c6e-fab3-44a5-a197-0f1d119186b9 for instance 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 on hv-cinder-85200 Aug 10 13:50:38.434765 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-7e69ca02-9eb4-45c7-9e2f-b76aea354c30 req-8e28b5eb-fff0-4781-a95b-a7fc22a6dc0e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038266 Aug 10 13:50:38.435398 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 548/1064] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:51:14.062777 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:51:14.063732 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Wed Aug 10 13:51:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 13:51:50.434111 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_api:SELECT=26 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:51:50.434963 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG dbcounter [-] [129523] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:51:50.437440 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:51:50.438628 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG dbcounter [-] [129522] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:51:50.440037 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-e67db296-1250-4eb2-93b4-7fd376db41ea tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:51:50.440826 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-e67db296-1250-4eb2-93b4-7fd376db41ea tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:51:50.449706 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e67db296-1250-4eb2-93b4-7fd376db41ea tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:51:50.450589 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e67db296-1250-4eb2-93b4-7fd376db41ea tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:51:50.451129 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e67db296-1250-4eb2-93b4-7fd376db41ea tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:51:50.452267 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e67db296-1250-4eb2-93b4-7fd376db41ea tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:51:50.452977 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e67db296-1250-4eb2-93b4-7fd376db41ea tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:51:50.453549 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-e67db296-1250-4eb2-93b4-7fd376db41ea tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:51:50.485377 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-e67db296-1250-4eb2-93b4-7fd376db41ea tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Going to try to terminate instance {{(pid=129523) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:51:50.511451 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-d50482fb-ecdd-4b25-8f13-6a9457affb25 req-349a2318-3a39-4997-9661-2cac021330fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "693f95ba-4b43-4f87-88a3-80c2c0ec0fb7", "tag": "73ad5c6e-fab3-44a5-a197-0f1d119186b9"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:51:50.523976 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-d50482fb-ecdd-4b25-8f13-6a9457affb25 req-349a2318-3a39-4997-9661-2cac021330fa service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:51:50.524855 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-d50482fb-ecdd-4b25-8f13-6a9457affb25 req-349a2318-3a39-4997-9661-2cac021330fa service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:51:50.525606 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-d50482fb-ecdd-4b25-8f13-6a9457affb25 req-349a2318-3a39-4997-9661-2cac021330fa service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:51:50.538630 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-d50482fb-ecdd-4b25-8f13-6a9457affb25 req-349a2318-3a39-4997-9661-2cac021330fa service nova] Creating event network-changed:73ad5c6e-fab3-44a5-a197-0f1d119186b9 for instance 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 on hv-cinder-85200 Aug 10 13:51:50.544487 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-d50482fb-ecdd-4b25-8f13-6a9457affb25 req-349a2318-3a39-4997-9661-2cac021330fa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108930 Aug 10 13:51:50.545612 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 549/1065] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:51:50.577553 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-e67db296-1250-4eb2-93b4-7fd376db41ea tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "DELETE /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 204 len: 0 microversion: 2.1 time: 0.144863 Aug 10 13:51:50.583313 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 517/1066] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 10 13:51:50 2022] DELETE /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:51:50.588938 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-3c51ef34-bdf8-46ca-8616-fcb59072bff1 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:51:50.589950 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-3c51ef34-bdf8-46ca-8616-fcb59072bff1 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:51:50.596337 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3c51ef34-bdf8-46ca-8616-fcb59072bff1 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:51:50.596885 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3c51ef34-bdf8-46ca-8616-fcb59072bff1 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:51:50.597361 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3c51ef34-bdf8-46ca-8616-fcb59072bff1 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:51:50.598111 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3c51ef34-bdf8-46ca-8616-fcb59072bff1 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:51:50.598550 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3c51ef34-bdf8-46ca-8616-fcb59072bff1 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:51:50.598981 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-3c51ef34-bdf8-46ca-8616-fcb59072bff1 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:51:50.744540 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.policy [None req-3c51ef34-bdf8-46ca-8616-fcb59072bff1 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129522) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:51:50.753741 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-3c51ef34-bdf8-46ca-8616-fcb59072bff1 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1569 microversion: 2.1 time: 0.168855 Aug 10 13:51:50.754634 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 550/1067] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:51:50 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:51:51.775729 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-ea905edb-c1a5-4570-b257-03806870485a tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:51:51.776436 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-ea905edb-c1a5-4570-b257-03806870485a tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:51:51.782974 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ea905edb-c1a5-4570-b257-03806870485a tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:51:51.783465 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ea905edb-c1a5-4570-b257-03806870485a tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:51:51.783906 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ea905edb-c1a5-4570-b257-03806870485a tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:51:51.784692 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ea905edb-c1a5-4570-b257-03806870485a tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:51:51.785149 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ea905edb-c1a5-4570-b257-03806870485a tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:51:51.785608 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-ea905edb-c1a5-4570-b257-03806870485a tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:51:51.990858 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-ea905edb-c1a5-4570-b257-03806870485a tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:51:51.999615 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-ea905edb-c1a5-4570-b257-03806870485a tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1569 microversion: 2.1 time: 0.228070 Aug 10 13:51:52.000195 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 518/1068] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:51:51 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1569 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:51:52.678646 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [req-7376a5ba-686f-4258-80f7-fd0d2beb9b39 req-f7191f25-e9cb-4942-9fe8-138bf16a78cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "693f95ba-4b43-4f87-88a3-80c2c0ec0fb7", "name": "network-vif-deleted", "tag": "73ad5c6e-fab3-44a5-a197-0f1d119186b9"}]} {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:51:52.688308 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-7376a5ba-686f-4258-80f7-fd0d2beb9b39 req-f7191f25-e9cb-4942-9fe8-138bf16a78cc service nova] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:51:52.688807 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-7376a5ba-686f-4258-80f7-fd0d2beb9b39 req-f7191f25-e9cb-4942-9fe8-138bf16a78cc service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:51:52.689258 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [req-7376a5ba-686f-4258-80f7-fd0d2beb9b39 req-f7191f25-e9cb-4942-9fe8-138bf16a78cc service nova] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:51:52.700248 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.compute.server_external_events [req-7376a5ba-686f-4258-80f7-fd0d2beb9b39 req-f7191f25-e9cb-4942-9fe8-138bf16a78cc service nova] Creating event network-vif-deleted:73ad5c6e-fab3-44a5-a197-0f1d119186b9 for instance 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 on hv-cinder-85200 Aug 10 13:51:52.705088 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [req-7376a5ba-686f-4258-80f7-fd0d2beb9b39 req-f7191f25-e9cb-4942-9fe8-138bf16a78cc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085188 Aug 10 13:51:52.705710 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 551/1069] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 10 13:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:51:53.022203 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-7fb4fe54-6706-4a91-a5ca-93469555dd4b tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:51:53.022922 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.compute.api [None req-7fb4fe54-6706-4a91-a5ca-93469555dd4b tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129523) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:51:53.030087 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7fb4fe54-6706-4a91-a5ca-93469555dd4b tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:51:53.030646 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7fb4fe54-6706-4a91-a5ca-93469555dd4b tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:51:53.031144 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7fb4fe54-6706-4a91-a5ca-93469555dd4b tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:51:53.031819 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7fb4fe54-6706-4a91-a5ca-93469555dd4b tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:51:53.032274 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7fb4fe54-6706-4a91-a5ca-93469555dd4b tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:51:53.032697 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG oslo_concurrency.lockutils [None req-7fb4fe54-6706-4a91-a5ca-93469555dd4b tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:51:53.100192 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.policy [None req-7fb4fe54-6706-4a91-a5ca-93469555dd4b tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7f0324eba3466aa985febfaf47b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d732726c004517ad7e771af3f3b805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129523) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:51:53.108667 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-7fb4fe54-6706-4a91-a5ca-93469555dd4b tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 200 len: 1219 microversion: 2.1 time: 0.091304 Aug 10 13:51:53.109376 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 519/1070] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:51:53 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:51:54.131999 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-cfdea89a-c019-4483-bb9c-89eccaddcdc4 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '>' {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:51:54.132692 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.compute.api [None req-cfdea89a-c019-4483-bb9c-89eccaddcdc4 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [instance: 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7] Fetching instance by UUID {{(pid=129522) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:51:54.138986 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cfdea89a-c019-4483-bb9c-89eccaddcdc4 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:51:54.139464 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cfdea89a-c019-4483-bb9c-89eccaddcdc4 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:51:54.139892 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cfdea89a-c019-4483-bb9c-89eccaddcdc4 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:51:54.140578 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cfdea89a-c019-4483-bb9c-89eccaddcdc4 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Acquiring lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:51:54.141023 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cfdea89a-c019-4483-bb9c-89eccaddcdc4 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:51:54.141466 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG oslo_concurrency.lockutils [None req-cfdea89a-c019-4483-bb9c-89eccaddcdc4 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Lock "6d22d841-55fc-4fd5-b0b7-709b32bc1d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:51:54.154501 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.wsgi [None req-cfdea89a-c019-4483-bb9c-89eccaddcdc4 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] HTTP exception thrown: Instance 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 could not be found. Aug 10 13:51:54.156125 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-cfdea89a-c019-4483-bb9c-89eccaddcdc4 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Request method failure captured: Aug 10 13:51:54.156125 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: request: GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 HTTP/1.1 Aug 10 13:51:54.156125 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept: application/json Aug 10 13:51:54.156125 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Accept-Encoding: identity Aug 10 13:51:54.156125 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Connection: close Aug 10 13:51:54.156125 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Length: 0 Aug 10 13:51:54.156125 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Content-Type: application/json Aug 10 13:51:54.156125 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Host: 10.222.0.52 Aug 10 13:51:54.156125 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Openstack-System-Scope: None Aug 10 13:51:54.156125 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: User-Agent: python-urllib3/1.26.11 Aug 10 13:51:54.156125 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Auth-Token: gAAAAABi87bt3kB1I_wc7H-c1xdNaBGC6X-qStBGsYlp9-7nYYs5gqMgAFkgClLRWNzM_pi5qRKOzuAtvbd2VxnPancRpyxO_Toj8AxfBgCdMKkBH-hC4hfiY7ifMXE44Qco_TjUjAByFljmWOk-VHh_LBZA4RxamfA9fn3IT47A2Z8odVbMRZc Aug 10 13:51:54.156125 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Id: None Aug 10 13:51:54.156125 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Domain-Name: None Aug 10 13:51:54.156125 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Identity-Status: Confirmed Aug 10 13:51:54.156125 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Is-Admin-Project: True Aug 10 13:51:54.156125 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Id: default Aug 10 13:51:54.156125 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Domain-Name: Default Aug 10 13:51:54.156125 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Id: 15d732726c004517ad7e771af3f3b805 Aug 10 13:51:54.156125 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Project-Name: tempest-TestShelveInstance-1338437718 Aug 10 13:51:54.156125 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Role: member,reader Aug 10 13:51:54.156125 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Roles: member,reader Aug 10 13:51:54.157857 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/15d732726c004517ad7e771af3f3b805"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/15d732726c004517ad7e771af3f3b805"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_15d732726c004517ad7e771af3f3b805", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/15d732726c004517ad7e771af3f3b805"}]}] Aug 10 13:51:54.157857 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant: tempest-TestShelveInstance-1338437718 Aug 10 13:51:54.157857 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Id: 15d732726c004517ad7e771af3f3b805 Aug 10 13:51:54.157857 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-Tenant-Name: tempest-TestShelveInstance-1338437718 Aug 10 13:51:54.157857 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User: tempest-TestShelveInstance-1338437718-project Aug 10 13:51:54.157857 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Id: default Aug 10 13:51:54.157857 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Domain-Name: Default Aug 10 13:51:54.157857 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Id: 0a7f0324eba3466aa985febfaf47b990 Aug 10 13:51:54.157857 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: X-User-Name: tempest-TestShelveInstance-1338437718-project Aug 10 13:51:54.157857 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: method: > Aug 10 13:51:54.157857 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: exception: Instance 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 could not be found. Aug 10 13:51:54.157857 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: action_args: {'id': '693f95ba-4b43-4f87-88a3-80c2c0ec0fb7'} Aug 10 13:51:54.158935 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: {{(pid=129522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:51:54.158935 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:51:54.158935 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:51:54.158935 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:51:54.158935 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:51:54.158935 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:51:54.158935 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:51:54.158935 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:51:54.158935 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:51:54.158935 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:51:54.158935 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 could not be found. Aug 10 13:51:54.158935 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:51:54.158935 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:51:54.158935 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:51:54.158935 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:51:54.158935 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:51:54.158935 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:51:54.158935 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:51:54.158935 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:51:54.158935 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:51:54.160719 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:51:54.160719 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:51:54.160719 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:51:54.160719 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:51:54.160719 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:51:54.160719 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:51:54.160719 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:51:54.160719 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 could not be found. Aug 10 13:51:54.160719 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:51:54.160719 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:51:54.160719 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:51:54.160719 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:51:54.160719 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:51:54.160719 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:51:54.160719 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:51:54.160719 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:51:54.160719 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 could not be found. Aug 10 13:51:54.160719 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: ERROR nova.api.openstack.wsgi Aug 10 13:51:54.162296 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: DEBUG nova.api.openstack.wsgi [None req-cfdea89a-c019-4483-bb9c-89eccaddcdc4 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Returning 404 to user: Instance 693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 could not be found. {{(pid=129522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:51:54.162296 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO nova.api.openstack.requestlog [None req-cfdea89a-c019-4483-bb9c-89eccaddcdc4 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7" status: 404 len: 111 microversion: 2.1 time: 0.030747 Aug 10 13:51:54.162296 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: [pid: 129522|app: 0|req: 552/1071] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 10 13:51:54 2022] GET /compute/v2.1/servers/693f95ba-4b43-4f87-88a3-80c2c0ec0fb7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:51:54.323075 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: DEBUG nova.api.openstack.wsgi [None req-843a1bca-9d3b-40ae-8598-b12719567b54 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] Calling method '.version_select at 0x7f49c44c55e0>' {{(pid=129523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:51:54.327734 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: ERROR oslo.messaging._drivers.impl_rabbit [None req-843a1bca-9d3b-40ae-8598-b12719567b54 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [731ce2f3-65ed-49a5-a149-44c3778e6c51] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 13:51:55.334834 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO oslo.messaging._drivers.impl_rabbit [None req-843a1bca-9d3b-40ae-8598-b12719567b54 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] [731ce2f3-65ed-49a5-a149-44c3778e6c51] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 37480. Aug 10 13:51:55.353651 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO nova.api.openstack.requestlog [None req-843a1bca-9d3b-40ae-8598-b12719567b54 tempest-TestShelveInstance-1338437718 tempest-TestShelveInstance-1338437718-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-581234170" status: 202 len: 0 microversion: 2.1 time: 1.034422 Aug 10 13:51:55.354234 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: [pid: 129523|app: 0|req: 520/1072] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Aug 10 13:51:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-581234170 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:52:39.966523 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:52:39.967228 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Wed Aug 10 13:52:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 13:52:53.096523 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:52:53.097193 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Wed Aug 10 13:52:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 13:54:34.073326 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:54:34.074003 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Wed Aug 10 13:54:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 13:54:48.690310 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:54:48.690964 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Wed Aug 10 13:54:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 13:54:53.562513 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:54:53.563090 dv-cinder-852009-3-iscsi devstack@n-api.service[129523]: Wed Aug 10 13:54:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 13:55:59.977508 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:55:59.978154 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Wed Aug 10 13:55:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 13:56:13.105479 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:56:13.106939 dv-cinder-852009-3-iscsi devstack@n-api.service[129522]: Wed Aug 10 13:56:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!